conduit: Streaming data processing library.
conduit
is a solution to the streaming data problem, allowing for production, transformation, and consumption of streams of data in constant memory. It is an alternative to lazy I/O which guarantees deterministic resource handling, and fits in the same general solution space as enumerator
/iteratee
and pipes
. For a tutorial, please visit https://haskell.fpcomplete.com/user/snoyberg/library-documentation/conduit-overview.
Release history:
- 1.0
- Simplified the user-facing interface back to the Source, Sink, and Conduit types, with Producer and Consumer for generic code. Error messages have been simplified, and optional leftovers and upstream terminators have been removed from the external API. Some long-deprecated functions were finally removed.
- 0.5
- The internals of the package are now separated to the .Internal module, leaving only the higher-level interface in the advertised API. Internally, switched to a
Leftover
constructor and slightly tweaked the finalization semantics. - 0.4
- Inspired by the design of the pipes package: we now have a single unified type underlying
Source
,Sink
, andConduit
. This type is namedPipe
. There are type synonyms provided for the other three types. Additionally,BufferedSource
is no longer provided. Instead, the connect-and-resume operator,$$+
, can be used for the same purpose. - 0.3
- ResourceT has been greatly simplified, specialized for IO, and moved into a separate package. Instead of hard-coding ResourceT into the conduit datatypes, they can now live around any monad. The Conduit datatype has been enhanced to better allow generation of streaming output. The SourceResult, SinkResult, and ConduitResult datatypes have been removed entirely.
- 0.2
- Instead of storing state in mutable variables, we now use CPS. A
Source
returns the nextSource
, and likewise forSink
s andConduit
s. Not only does this take better advantage of GHC's optimizations (about a 20% speedup), but it allows some operations to have a reduction in algorithmic complexity from exponential to linear. This also allowed us to remove thePrepared
set of types. Also, theState
functions (e.g.,sinkState
) use better constructors for return types, avoiding the need for a dummy state on completion. - 0.1
BufferedSource
is now an abstract type, and has a much more efficient internal representation. The result was a 41% speedup on microbenchmarks (note: do not expect speedups anywhere near that in real usage). In general, we are moving towardsBufferedSource
being a specific tool used internally as needed, but usingSource
for all external APIs.- 0.0
- Initial release.
Modules
[Index]
Flags
Automatic Flags
Name | Description | Default |
---|---|---|
nohandles | experimental code to use raw system calls in place of handles. Not recommended for general use | Disabled |
Use -f <flag> to enable a flag, or -f -<flag> to disable that flag. More info
Downloads
- conduit-1.0.11.tar.gz [browse] (Cabal source package)
- Package description (revised from the package)
Note: This package has metadata revisions in the cabal description newer than included in the tarball. To unpack the package including the revisions, use 'cabal get'.
Maintainer's Corner
For package maintainers and hackage trustees
Candidates