Language.CSPM.LexHelper
- lexInclude :: String -> IO (Either LexError [Token])
- lexPlain :: String -> Either LexError [Token]
- removeIgnoredToken :: [Token] -> [Token]
- tokenIsComment :: Token -> Bool
- unicodeTokenString :: Token -> String
- asciiTokenString :: Token -> String
Documentation
lexInclude :: String -> IO (Either LexError [Token])Source
lex a String and process CSP-M include statements.
removeIgnoredToken :: [Token] -> [Token]Source
Remove comments, whitespaces and unneeded newlines.
tokenIsComment :: Token -> BoolSource
Is the token a line-comment, block-comment or a Pragma?
unicodeTokenString :: Token -> StringSource
Convert a token to a String. If the tokenClasss has a Unicode symbol return the default Unicode string.
asciiTokenString :: Token -> StringSource
Convert a token to a String. If the tokenClasss has a Unicode symbol return the default ASCII string.