tokenize-0.3.0: Simple tokenizer for English text.

Index

allPunctuation 
1 (Function)NLP.Tokenize.Text
2 (Function)NLP.Tokenize.String, NLP.Tokenize
contractions 
1 (Function)NLP.Tokenize.Text
2 (Function)NLP.Tokenize.String, NLP.Tokenize
defaultTokenizer 
1 (Function)NLP.Tokenize.Text
2 (Function)NLP.Tokenize.String, NLP.Tokenize
E 
1 (Data Constructor)NLP.Tokenize.Text
2 (Data Constructor)NLP.Tokenize.String, NLP.Tokenize
EitherList 
1 (Type/Class)NLP.Tokenize.Text
2 (Type/Class)NLP.Tokenize.String, NLP.Tokenize
finalPunctuation 
1 (Function)NLP.Tokenize.Text
2 (Function)NLP.Tokenize.String, NLP.Tokenize
initialPunctuation 
1 (Function)NLP.Tokenize.Text
2 (Function)NLP.Tokenize.String, NLP.Tokenize
negatives 
1 (Function)NLP.Tokenize.Text
2 (Function)NLP.Tokenize.String, NLP.Tokenize
punctuation 
1 (Function)NLP.Tokenize.Text
2 (Function)NLP.Tokenize.String, NLP.Tokenize
run 
1 (Function)NLP.Tokenize.Text
2 (Function)NLP.Tokenize.String, NLP.Tokenize
tokenize 
1 (Function)NLP.Tokenize.Text
2 (Function)NLP.Tokenize.String, NLP.Tokenize
Tokenizer 
1 (Type/Class)NLP.Tokenize.Text
2 (Type/Class)NLP.Tokenize.String, NLP.Tokenize
unE 
1 (Function)NLP.Tokenize.Text
2 (Function)NLP.Tokenize.String, NLP.Tokenize
uris 
1 (Function)NLP.Tokenize.Text
2 (Function)NLP.Tokenize.String, NLP.Tokenize
whitespace 
1 (Function)NLP.Tokenize.Text
2 (Function)NLP.Tokenize.String, NLP.Tokenize