GLL.Combinators.Lexer

Documentation

default_lexer :: SubsumesToken t => String -> [t]

A lexer using the default LexerSettings.

lexer :: SubsumesToken t => LexerSettings -> String -> [t]

A lexer parameterised by LexerSettings.

data LexerSettings

Settings for changing the behaviour of the builtin lexer lexer. Lexers are built using Text.Regex.Applicative.

Constructors

LexerSettings

Fields

• keychars :: [Char]

  Which keychars to recognise? Default: none.

• keywords :: [String]

  Which keywords to recognise? Default: none.

• whitespace :: Char -> Bool

  What is considered a whitespace character? Default: isSpace.

• lineComment :: String

  How does a line comment start? Default: '"//"'.

• blockCommentOpen :: String

  How does a block comment open? Default: '"'{-'"'.

• blockCommentClose :: String

  How does a block comment close? Default: '"'-}'"'.

• identifiers :: RE Char String

  How to recognise identifiers? Default alphanumerical with lowercase alpha start.

• altIdentifiers :: RE Char String

  How to recognise alternative identifiers? Default alphanumerical with uppercase alpha start.

• tokens :: [(String, RE Char String)]

  Arbitrary tokens (a,b). a is the token name, b is a regular expression.

emptyLanguage :: LexerSettings

The default LexerSettings.