shpider: Web automation library in Haskell.

[ bsd3, library, web ] [ Propose Tags ]

Shpider is a web automation library for Haskell. It allows you to quickly write crawlers, and for simple cases ( like following links ) even without reading the page source.

It has useful features such as turning relative links from a page into absolute links, options to authorize transactions only on a given domain, and the option to only download html documents.

It also provides a nice syntax for filling out forms.

An example:

runShpider $ do
     download ""
     theForm : _ <- getFormsByAction ""
     sendForm $ fillOutForm theForm $ pairs $ do
           "occupation" =: "unemployed Haskell programmer"
           "location" =: "mother's house"


Maintainer's Corner

Package maintainers

For package maintainers and hackage trustees


  • No Candidates
Versions [RSS] 0.0.1, 0.0.2, 0.0.3, 0.0.4, 0.0.5, 0.0.6, 0.0.7, 0.1.0, 0.1.1, 0.2,
Dependencies base (<5), bytestring, containers, curl, mtl, regex-posix, tagsoup, tagsoup-parsec (>=0.0.8), time, url (>=2), web-encodings [details]
License BSD-3-Clause
Author Johnny Morrice <>, Ozgun Ataman
Maintainer Ozgun Ataman <>
Category Web
Home page
Uploaded by OzgunAtaman at 2011-11-29T18:26:57Z
Reverse Dependencies 1 direct, 0 indirect [details]
Downloads 7808 total (15 in the last 30 days)
Rating (no votes yet) [estimated by Bayesian average]
Your Rating
  • λ
  • λ
  • λ
Status Docs uploaded by user
Build status unknown [no reports yet]