Network.HTTP.Download

Documentation

verifiedDownload

Arguments

:: (MonadReader env m, HasHttpManager env, MonadIO m, MonadLogger m)

=> DownloadRequest

-> Path Abs File

destination

-> (Maybe Integer -> Sink ByteString (ReaderT env IO) ())

custom hook to observe progress

-> m Bool

Whether a download was performed

Copied and extended version of Network.HTTP.Download.download.

Has the following additional features: * Verifies that response content-length header (if present) matches expected length * Limits the download to (close to) the expected # of bytes * Verifies that the expected # bytes were downloaded (not too few) * Verifies md5 if response includes content-md5 header * Verifies the expected hashes

Throws VerifiedDownloadException. Throws IOExceptions related to file system operations. Throws HttpException.

data DownloadRequest

A request together with some checks to perform.

Constructors

DownloadRequest

Fields

drRequest :: Request

drHashChecks :: [HashCheck]

drLengthCheck :: Maybe LengthCheck

drRetryPolicy :: RetryPolicy

drRetryPolicyDefault :: RetryPolicy

Default to retrying thrice with a short constant delay.

data HashCheck

Constructors

forall a . (Show a, HashAlgorithm a) => HashCheck

Fields

hashCheckAlgorithm :: a

hashCheckHexDigest :: CheckHexDigest

Instances

Show HashCheck

data DownloadException

Constructors

DownloadJSONException Request String

RedownloadFailed Request (Path Abs File) (Response ())

Instances

Show DownloadException

Exception DownloadException

data CheckHexDigest

Constructors

CheckHexDigestString String

CheckHexDigestByteString ByteString

CheckHexDigestHeader ByteString

Instances

Show CheckHexDigest

IsString CheckHexDigest

type LengthCheck = Int

data VerifiedDownloadException

An exception regarding verification of a download.

Constructors

WrongContentLength Request Int ByteString

WrongStreamLength Request Int Int

WrongDigest Request String CheckHexDigest String

Instances

Show VerifiedDownloadException

Exception VerifiedDownloadException

download

Arguments

:: (MonadReader env m, HasHttpManager env, MonadIO m, MonadLogger m)

=> Request

-> Path Abs File

destination

-> m Bool

Was a downloaded performed (True) or did the file already exist (False)?

Download the given URL to the given location. If the file already exists, no download is performed. Otherwise, creates the parent directory, downloads to a temporary file, and on file download completion moves to the appropriate destination.

Throws an exception if things go wrong

redownload

Arguments

:: (MonadReader env m, HasHttpManager env, MonadIO m, MonadLogger m)

=> Request

-> Path Abs File

destination

-> m Bool

Same as download, but will download a file a second time if it is already present.

Returns True if the file was downloaded, False otherwise

downloadJSON :: (FromJSON a, MonadReader env m, HasHttpManager env, MonadIO m, MonadMask m) => Request -> m a

Download a JSON value and parse it using a FromJSON instance.

parseRequest :: MonadThrow m => String -> m Request

Convert a URL into a Request.

This defaults some of the values in Request, such as setting method to GET and requestHeaders to [].

Since this function uses MonadThrow, the return monad can be anything that is an instance of MonadThrow, such as IO or Maybe.

You can place the request method at the beginning of the URL separated by a space, e.g.:

@@ parseRequeset "POST http://httpbin.org/post" @@

Note that the request method must be provided as all capital letters.

Since: 0.4.30

parseUrlThrow :: MonadThrow m => String -> m Request

Same as parseRequest, except will throw an HttpException in the event of a non-2XX response.

Since: 0.4.30

liftHTTP :: (MonadIO m, MonadReader env m, HasHttpManager env) => ReaderT Manager IO a -> m a

A convenience method for asking for the environment and then running an action with its Manager. Useful for avoiding a MonadBaseControl constraint.

ask :: MonadReader r m => m r

Retrieves the monad environment.

getHttpManager :: HasHttpManager a => a -> Manager

class Monad m => MonadReader r m | m -> r where

See examples in Control.Monad.Reader. Note, the partially applied function type (->) r is a simple reader monad. See the instance declaration below.

Minimal complete definition

(ask | reader), local

Methods

ask :: m r

Retrieves the monad environment.

Instances

MonadReader r m => MonadReader r (MaybeT m)

MonadReader r m => MonadReader r (ListT m)

MonadReader r m => MonadReader r (IdentityT m)

MonadReader r ((->) r)

MonadReader r m => MonadReader r (ResourceT m)

MonadReader r m => MonadReader r (LoggingT m)

(Representable f, (~) * (Rep f) a) => MonadReader a (Co f)

(Functor m, MonadReader e m) => MonadReader e (Free m)

(Monoid w, MonadReader r m) => MonadReader r (WriterT w m)

(Monoid w, MonadReader r m) => MonadReader r (WriterT w m)

MonadReader r m => MonadReader r (StateT s m)

MonadReader r m => MonadReader r (StateT s m)

Monad m => MonadReader r (ReaderT r m)

MonadReader r m => MonadReader r (ExceptT e m)

(Error e, MonadReader r m) => MonadReader r (ErrorT e m)

MonadReader r' m => MonadReader r' (ContT r m)

MonadReader r m => MonadReader r (RandT g m)

MonadReader r m => MonadReader r (EitherT e m)

MonadReader r m => MonadReader r (ConduitM i o m)

MonadReader r m => MonadReader r (ParsecT s u m)

(Monad m, Monoid w) => MonadReader r (RWST r w s m)

(Monad m, Monoid w) => MonadReader r (RWST r w s m)

MonadReader r m => MonadReader r (Pipe l i o u m)

Monad m => MonadReader (Env config) (StackT config m)

class HasHttpManager a where

Methods

getHttpManager :: a -> Manager

Instances

HasHttpManager Manager

HasHttpManager MiniConfig

HasHttpManager (Env config)