cabal-version: >= 1.6 name: http-conduit-downloader version: 1.0.10 x-revision: 1 copyright: Vladimir Shabanov 2013 author: Vladimir Shabanov maintainer: Vladimir Shabanov homepage: https://github.com/bazqux/http-conduit-downloader license: BSD3 category: Web license-file: LICENSE build-type: Simple synopsis: HTTP downloader tailored for web-crawler needs. description: HTTP/HTTPS downloader built on top of @http-conduit@ and used in crawler. . * Handles all possible http-conduit exceptions and returns human readable error messages. . * Handles some web server bugs (returning 'deflate' data instead of 'gzip'). . * Ignores invalid SSL sertificates. . * Receives data in 32k blocks internally to reduce memory fragmentation on many parallel downloads. . * Download timeout. . * Total download size limit. . * Returns HTTP headers for subsequent redownloads and handles 'Not modified' results. . * Can be used with external DNS resolver (hsdns-cache for example). source-repository head type: git location: https://github.com/bazqux/http-conduit-downloader library build-depends: base == 4.*, http-conduit >= 1.9.4.1, network < 3, zlib, lifted-base, conduit, resourcet, http-types, tls, data-default, bytestring, mtl, time, old-locale exposed-modules: Network.HTTP.Conduit.Downloader ghc-options: -O2 -Wall