úÎ V     5The EitherList is a newtype-wrapped list of Eithers. IA Tokenizer is function which takes a list and returns a list of Eithers I (wrapped in a newtype). Right Strings will be passed on for processing  to tokenizers down L the pipeline. Left Strings will be passed through the pipeline unchanged. K Use a Left String in a tokenizer to protect certain tokens from further  processing (e.g. see the  tokenizer). >Split string into words using the default tokenizer pipeline Run a tokenizer #Detect common uris and freeze them (Split off initial and final punctuation !Split off word-final punctuation #Split off word-initial punctuation Split words ending in n't , and freeze n't 7Split string on whitespace. This is just a wrapper for            tokenize-0.1.0 NLP.Tokenize EitherListEunE Tokenizertokenizerunuris punctuationfinalPunctuationinitialPunctuation negatives whitespacebase Data.Listwords