Portability | GHC |
---|---|
Stability | unstable |
Maintainer | stephen.tetley@gmail.com |
Simple tokenizing builder.
Documentation
data TokenizerConfig Source
haskellTokenizer :: RGBi -> RGBi -> TokenizerConfigSource
runTokenizer :: TokenizerConfig -> String -> GreekTextSource