The shpider package

[Tags: bsd3, library]

Shpider is a web automation library for Haskell. It allows you to quickly write crawlers, and for simple cases ( like following links ) even without reading the page source.

It has useful features such as turning relative links from a page into absolute links, options to authorize transactions only on a given domain, and the option to only download html documents.

It also provides a nice syntax for filling out forms.

An example:

 runShpider $ do
      download "http://apage.com"
      theForm : _ <- getFormsByAction "http://anotherpage.com"
      sendForm $ fillOutForm theForm $ pairs $ do
            "occupation" =: "unemployed Haskell programmer"
            "location" =: "mother's house"

Properties

Versions0.0.1, 0.0.2, 0.0.3, 0.0.4, 0.0.5, 0.0.6, 0.0.7, 0.1.0, 0.1.1, 0.2, 0.2.1.1
Dependenciesbase (<5), bytestring, containers, curl, mtl, regex-posix, tagsoup, tagsoup-parsec (>=0.0.8), time, url (>=2), web-encodings
LicenseBSD3
AuthorJohnny Morrice <spoon@killersmurf.com>, Ozgun Ataman
MaintainerOzgun Ataman <ozataman@gmail.com>
CategoryWeb
Home pagehttp://github.com/ozataman/shpider
Upload dateTue Nov 29 18:26:57 UTC 2011
Uploaded byOzgunAtaman
Downloads627 total (43 in last 30 days)

Modules

[Index]

Downloads

Maintainers' corner

For package maintainers and hackage trustees