HaskellWorks.Data.Conduit.Tokenize.Attoparsec.Internal

Consume attoparsec parsers via conduit.

This code was taken from attoparsec-enumerator and adapted for conduits.

Sink

sinkParser :: (AttoparsecInput a, AttoparsecState a s, MonadThrow m, Exception (ParseError s)) => s -> Parser a b -> Consumer a m b

Convert an Attoparsec Parser into a Sink. The parser will be streamed bytes until it returns Done or Fail.

If parsing fails, a ParseError will be thrown with monadThrow.

Since 0.5.0

sinkParserEither :: (AttoparsecInput a, AttoparsecState a s, Monad m) => s -> Parser a b -> Consumer a m (Either (ParseError s) b)

Same as sinkParser, but we return an Either type instead of raising an exception.

Since 1.1.5

Conduit

conduitParser :: (AttoparsecInput a, AttoparsecState a s, MonadThrow m, Exception (ParseError s)) => s -> Parser a b -> Conduit a m (ParseDelta s, b)

Consume a stream of parsed tokens, returning both the token and the position it appears at. This function will raise a ParseError on bad input.

Since 0.5.0

conduitParserEither :: (Monad m, AttoparsecInput a, AttoparsecState a s) => s -> Parser a b -> Conduit a m (Either (ParseError s) (ParseDelta s, b))

Same as conduitParser, but we return an Either type instead of raising an exception.

Types

data ParseError s

The context and message from a Fail value.

Constructors

ParseError

Fields

errorContexts :: [String]

errorMessage :: String

errorPosition :: s

DivergentParser

Instances

Show s => Show (ParseError s)

Exception (ParseError Position)

Exception (ParseError Offset)

data ParseDelta s

The before and after state of a single parse in a conduit stream.

Constructors

ParseDelta

Fields

before :: !s

after :: !s

Instances

Eq s => Eq (ParseDelta s)

Ord s => Ord (ParseDelta s)

Show (ParseDelta Position)

Show (ParseDelta Offset)

Classes

class AttoparsecInput a where

A class of types which may be consumed by an Attoparsec parser.

Methods

parseA :: Parser a b -> a -> IResult a b

feedA :: IResult a b -> a -> IResult a b

empty :: a

isNull :: a -> Bool

notEmpty :: [a] -> [a]

stripFromEnd :: a -> a -> a

Return the beginning of the first input with the length of the second input removed. Assumes the second string is shorter than the first.

Instances

AttoparsecInput ByteString

AttoparsecInput Text

class AttoparsecState a s where

A class of types and states which may be consumed by an Attoparsec parser.

Methods

getState :: a -> s

modState :: AttoparsecInput a => a -> s -> s

Instances

AttoparsecState ByteString Position

AttoparsecState ByteString Offset

AttoparsecState Text Position

AttoparsecState Text Offset