GroteTrap-0.1: GroteTrap

Language.GroteTrap.Lexer

Contents

Description

Deriving a lexer from a Language.

Synopsis

Types

data Token Source

The tokenizer produces a list of tokens.

Constructors

TId String 
TInt Int 
TOperator String 
TFunction String 
TOpen 
TClose 
TComma 
TWhite Int 

Instances

type TokenPos = (Pos, Token)Source

Tokenizing

tokenize :: Language a -> Parser [TokenPos]Source

When giver a language, transforms a list of characters into a list of tokens.

isWhite :: Token -> BoolSource

Whether the token is whitespace.