The shpider package

[Tags: bsd3, library]

Shpider is a web automation library for Haskell. It allows you to quickly write crawlers, and for simple cases ( like following links ) even without reading the page source.

It has useful features such as turning relative links from a page into absolute links, options to authorize transactions only on a given domain, and the option to only downloading html documents.

It also provides a nice syntax for filling out forms.

An example:

 runShpider $ do
      download "http://apage.com"
      theForm : _ <- getFormsByAction "http://anotherpage.com"
      sendForm $ fillOutForm theForm $ pairs $ do
            "occupation" =: "unemployed Haskell programmer"
            "location" =: "mother's house"

Shpider contains a patched version of the curl package, to fix cookie handling. The curl licence is therefore distributed with this package.


Properties

Versions0.0.1, 0.0.2, 0.0.3, 0.0.4, 0.0.5, 0.0.6, 0.0.7, 0.1.0, 0.1.1, 0.2, 0.2.1.1
Dependenciesbase, bytestring, containers, mtl, regex-posix, tagsoup, tagsoup-parsec, url
LicenseBSD3
AuthorJohnny Morrice
MaintainerJohnny Morrice <spoon@killersmurf.com>
CategoryWeb
Home pagehttp://www.killersmurf.com/projects/shpider
Upload dateFri Mar 20 18:16:49 UTC 2009
Uploaded byJohnnyMorrice
Downloads696 total (69 in last 30 days)

Modules

[Index]

Downloads

Maintainers' corner

For package maintainers and hackage trustees