shpider: Web automation library in Haskell.

Shpider is a web automation library for Haskell. It allows you to quickly write crawlers, and for simple cases ( like following links ) even without reading the page source.

It has useful features such as turning relative links from a page into absolute links, options to authorize transactions only on a given domain, and the option to only download html documents.

It also provides a nice syntax for filling out forms.

An example:

runShpider $ do
     download "http://apage.com"
     theForm : _ <- getFormsByAction "http://anotherpage.com"
     sendForm $ fillOutForm theForm $ pairs $ do
           "occupation" =: "unemployed Haskell programmer"
           "location" =: "mother's house"

Shpider contains a patched version of the curl package, to fix cookie handling. The curl licence is therefore distributed with this package.

Modules

[Index]

Downloads

• shpider-0.0.2.tar.gz [browse] (Cabal source package)
• Package description (as included in the package)

Maintainer's Corner

Package maintainers

• JohnnyMorrice, OzgunAtaman

For package maintainers and hackage trustees

• edit package information

Candidates

• No Candidates