Text.Tokenify.CharSeq

An abstaction over string like data types to prevent restricting tokenizer to a particular data type, as there are many string types in haskell.

Documentation

class (Monoid a, Eq a) => CharSeq a where

This typeclass is designed to make the tokenizer more polymorphic, which is why it's a super set of both Monoid and Eq.

Methods

head :: a -> Maybe Char

The first char in a CharSeq

tail :: a -> a

Every char but the first in a CharSeq

cons :: Char -> a -> a

Pushes the to the head of a CharSeq

snoc :: a -> Char -> a

Pushes the to the end of a CharSeq

null :: a -> Bool

A CharSeq containing a single character

singleton :: Char -> a

Makes a CharSeq containing a single character

lineInfo :: a -> [Int]

Provides line information of a CharSeq

Instances

CharSeq Text

Enables Text to be used for tokenizer

CharSeq [Char]

the main purpose of this implemenation is make testing in the repl non-painful