Yi.Lexer.JavaScript

Documentation

initState :: HlState

alexScanToken :: (AlexState HlState, AlexInput) -> Maybe (Tok Token, (AlexState HlState, AlexInput))

Scan one token. Return (maybe) a token and a new state.

tokenToStyle :: Token -> UIStyle -> Style

Takes a Token and returns a style to be used for that type of token.

TODO: The elem check is potentially unnecessarily slow. We could split the Const constructor into two different ones, one for builtins and one for others.

type TT = Tok Token

data Token

The different tokens.

Constructors

Unknown

Res !Reserved

Str !String

Rex !String

Op !Operator

Special !Char

Number !String

ValidName !String

Comment !CommentType

Const !String

Instances

Eq Token

Show Token

data Reserved

The constructors for Reserved have an apostrophe as a suffix because Default is already used. Also note that Undefined' is not intended as some sort of "backup" reserved word for things we don't care about -- it really means the "undefined" built-in in JavaScript.

Constructors

Break'

Case'

Catch'

Continue'

Default'

Delete'

Do'

Else'

Finally'

For'

Function'

If'

In'

InstanceOf'

New'

Return'

Switch'

This'

Throw'

Try'

TypeOf'

Var'

Void'

While'

With'

True'

False'

Null'

Undefined'

Instances

Eq Reserved

Show Reserved

data Operator

The constructors for Operator have an apostrophe as a suffix because e.g. LT is already used by Prelude.

Constructors

Add'

Subtract'

Multiply'

Divide'

Modulo'

Increment'

Decrement'

Assign'

AddAssign'

SubtractAssign'

MultiplyAssign'

DivideAssign'

ModuloAssign'

Equals'

NotEquals'

GT'

GTE'

LT'

LTE'

EqualsType'

NotEqualsType'

And'

Or'

Not'

BitAnd'

BitOr'

BitXor'

LeftShift'

RightShift'

RightShiftZ'

BitNot'

Qualify'

Instances

Eq Operator

Show Operator

type HlState = Int

HlState is 0 when outside of a multi-line comment and -1 when inside one.

prefixOperators :: [Operator]

Prefix operators. NOTE: Add' is also a valid prefix operator, but since it's completely useless in the real world, we don't care about it here. Doing this makes parsing much, much easier.

infixOperators :: [Operator]

Infix operators.

postfixOperators :: [Operator]

Postfix operators.