úÎ«Æ      Safe-Inferred 5The EitherList is a newtype-wrapped list of Eithers. IA Tokenizer is function which takes a list and returns a list of Eithers I (wrapped in a newtype). Right Strings will be passed on for processing  to tokenizers down L the pipeline. Left Strings will be passed through the pipeline unchanged. K Use a Left String in a tokenizer to protect certain tokens from further  processing (e.g. see the  tokenizer). >Split string into words using the default tokenizer pipeline Run a tokenizer #Detect common uris and freeze them (Split off initial and final punctuation !Split off word-final punctuation #Split off word-initial punctuation Split words ending in n't, and freeze n't /Split common contractions off and freeze them.  | Currently deals with: 'm, 's, 'd, 've, 'll GSplit string on whitespace. This is just a wrapper for Data.List.words           tokenize-0.1.3 NLP.Tokenize EitherListEunE TokenizertokenizerundefaultTokenizeruris punctuationfinalPunctuationinitialPunctuation negatives contractions whitespaceunwrapexamples$fMonadEitherList