The conduit-tokenize-attoparsec package

[Tags:bsd3, library, program, test]

Please see

[Skip to Readme]


Dependencies attoparsec (>=0.10), base (>=4.7 && <5), bytestring, conduit (>=1.1 && <1.3), conduit-tokenize-attoparsec, resourcet (>=1.1), text [details]
License BSD3
Copyright 2016 John Ky
Author John Ky
Category Data, Conduit
Home page
Source repository head: git clone
Uploaded Sun Jan 31 03:18:59 UTC 2016 by newhoggy
Distributions NixOS:
Downloads 85 total (10 in the last 30 days)
0 []
Status Docs available [build log]
Last success reported on 2016-02-12 [all 1 reports]
Hackage Matrix CI




Maintainer's Corner

For package maintainers and hackage trustees

Readme for conduit-tokenize-attoparsec

Readme for conduit-tokenize-attoparsec-


Conduits for tokenizing streams.

conduit-tokenize-attoparsec is an extension to the conduit library based on Data.Conduit.Attoparsec that allows the tokenization of a stream whilst also tracking arbitrary state. The library includes in-built support for tracking such as line-column and stream offset, but can be extended with type-classes to support alternative state tracking.

For an example, see app/Main.hs


Prerequisites: haskell-stack is installed.

Run the following in the shell:

git clone
cd conduit-tokenize-attoparsec
stack setup
stack build
stack test
stack ghci --ghc-options -XOverloadedStrings \
  --main-is conduit-tokenize-attoparsec:exe:conduit-tokenize-attoparsec-example