skylighting-core-0.7.7: syntax highlighting library

Safe HaskellNone
LanguageHaskell2010

Skylighting.Tokenizer

Synopsis

Documentation

tokenize :: TokenizerConfig -> Syntax -> Text -> Either String [SourceLine] Source #

Tokenize some text using Syntax.

data TokenizerConfig Source #

Configuration options for tokenize.

Constructors

TokenizerConfig 

Fields