Text.Tokenify.Types

Common types used by Text.Tokenify

Documentation

type Tokenizer s a = [Token s a]

A series of Tokens which will match in sequencial order

type Token s a = (Regex s, Response s a)

Defines what is matches, and how to respond to said match

type Pos = (Int, Int)

The type for a token position in a file