GLL.Combinators.Lexer

Documentation

default_lexer :: SubsumesToken t => String -> [t]

A lexer using the default LexerSettings.

lexer :: SubsumesToken t => LexerSettings -> String -> [t]

A lexer parameterised by LexerSettings.

data LexerSettings

Settings for changing the behaviour of the builtin lexer lexer. Lexers are built using Text.Regex.Applicative.

Constructors

LexerSettings

Fields

• keychars :: [Char]

  Which keychars to recognise? Default: none.

• keywords :: [String]

  Which keywords to recognise? Default: none.

• whitespace :: Char -> Bool

  What is considered a whitespace character? Default: isSpace.

• lineComment :: String

  How does a line comment start? Default: '"//"'.

• blockCommentOpen :: String

  How does a block comment open? Default: '"'{-'"'.

• blockCommentClose :: String

  How does a block comment close? Default: '"'-}'"'.

• identifiers :: RE Char String

  How to recognise identifiers? Default alphanumerical with lowercase alpha start.

• altIdentifiers :: RE Char String

  How to recognise alternative identifiers? Default alphanumerical with uppercase alpha start.

• tokens :: [(String, RE Char String)]

  Arbitrary tokens (a,b). a is the token name, b is a regular expression.

emptyLanguage :: LexerSettings

The default LexerSettings.

oneOf :: Eq t => [t] -> RE t t

manyOf :: Eq t => [t] -> RE t [t]

someOf :: Eq t => [t] -> RE t [t]

baseToDec :: Int -> String -> Int

Convert numerical representation in a given base (max base = 16, written as string) into decimal representation (returned as Int)