Îõ³h* m ¸$      !"#0.3.0.1 Safe-Inferredõ tokenize4The EitherList is a newtype-wrapped list of Eithers.tokenizeØA Tokenizer is function which takes a list and returns a list of Eithers (wrapped in a newtype). Right Strings will be passed on for processing to tokenizers down the pipeline. Left Strings will be passed through the pipeline unchanged. Use a Left String in a tokenizer to protect certain tokens from further processing (e.g. see the â tokenizer). You can define your own custom tokenizer pipelines by chaining tokenizers together:tokenize