!%p      !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnoSafe=?ctokenizer-monad A monad for turtle tokenization.tokenizer-monadProceed to the next charactertokenizer-monadEWalk back to the previous character, unless it was discarded/emitted.tokenizer-monadPeek the current charactertokenizer-monad.Restore the state after the last emit/discard.tokenizer-monad8Break at the current position and emit the scanned tokentokenizer-monad;Break at the current position and discard the scanned tokentokenizer-monad)Have I reached the end of the input text?tokenizer-monad9Check if the next input chars agree with the given string tokenizer-monad&Peek the current character and proceed tokenizer-monadText types that can be split by the Tokenizer monad. In this module, instances are provided for String, strict Text, and lazy Text. If you are dealing with ASCII ByteStrings, you can find instances in the modules $Control.Monad.Tokenizer.Char8.Strict and "Control.Monad.Tokenizer.Char8.Lazytokenizer-monad,Proceed as long as a given function succeedstokenizer-monadJProceed as long as a given fold returns Just (generalization of walkWhile)tokenizer-monadBRepeat a given tokenizer as long as the end of text is not reached     Safe=?+tokenizer-monad=Tokenizer monad. Use runTokenizer or runTokenizerCS to run ittokenizer-monadEmbed a pure tokenizer into the monad. The arguments to the function are (visited string, remaining string), and the return value is expected to be (result, emitted tokens, remaining string).tokenizer-monad7Embed a pure tokenizer into the monad without a result.tokenizer-monadEmbed a pure tokenizer into the monad. The visited string is discarded, and the given function is run on the unvisited part. The return value is expected to be (result, emitted tokens, remaining string).tokenizer-monad$Natural transformation to convert between tokenizers of different text types. Note that this operation does not perform encoding/decoding (i.e. converting from ByteString to Text does not decode Unicode characters). To do so, use convertWith a provide the correct encoding/decoding functions.tokenizer-monadsNatural transformation to convert between tokenizers of different text types, using the given conversion functions.tokenizer-monad4Split a string into tokens using the given tokenizertokenizer-monadLSplit a string into tokens using the given tokenizer, case sensitive version    Safe>#tokenizer-monad=Tokenizer monad. Use runTokenizer or runTokenizerCS to run it$tokenizer-monad9Check if the next input chars agree with the given string%tokenizer-monadProceed to the next character&tokenizer-monadEWalk back to the previous character, unless it was discarded/emitted.'tokenizer-monad.Restore the state after the last emit/discard.(tokenizer-monadPeek the current character)tokenizer-monad&Peek the current character and proceed*tokenizer-monad8Break at the current position and emit the scanned token+tokenizer-monad;Break at the current position and discard the scanned token,tokenizer-monad)Have I reached the end of the input text?-tokenizer-monad,Proceed as long as a given function succeeds.tokenizer-monadJProceed as long as a given fold returns Just (generalization of walkWhile)/tokenizer-monadBRepeat a given tokenizer as long as the end of text is not reached0tokenizer-monad4Split a string into tokens using the given tokenizer1tokenizer-monadLSplit a string into tokens using the given tokenizer, case sensitive version2tokenizer-monadAssuming ASCII encoding#$%&'()*+,-./01#01/(,$%&)-.*+'SafeO3tokenizer-monad=Tokenizer monad. Use runTokenizer or runTokenizerCS to run it4tokenizer-monad9Check if the next input chars agree with the given string5tokenizer-monadProceed to the next character6tokenizer-monadEWalk back to the previous character, unless it was discarded/emitted.7tokenizer-monad.Restore the state after the last emit/discard.8tokenizer-monadPeek the current character9tokenizer-monad&Peek the current character and proceed:tokenizer-monad8Break at the current position and emit the scanned token;tokenizer-monad;Break at the current position and discard the scanned token<tokenizer-monad)Have I reached the end of the input text?=tokenizer-monad,Proceed as long as a given function succeeds>tokenizer-monadJProceed as long as a given fold returns Just (generalization of walkWhile)?tokenizer-monadBRepeat a given tokenizer as long as the end of text is not reached@tokenizer-monad4Split a string into tokens using the given tokenizerAtokenizer-monadLSplit a string into tokens using the given tokenizer, case sensitive versionBtokenizer-monadAssuming ASCII encoding3456789:;<=>?@A3@A?8<4569=>:;7Safea!Ctokenizer-monad=Tokenizer monad. Use runTokenizer or runTokenizerCS to run itDtokenizer-monad9Check if the next input chars agree with the given stringEtokenizer-monadProceed to the next characterFtokenizer-monadEWalk back to the previous character, unless it was discarded/emitted.Gtokenizer-monad.Restore the state after the last emit/discard.Htokenizer-monadPeek the current characterItokenizer-monad&Peek the current character and proceedJtokenizer-monad8Break at the current position and emit the scanned tokenKtokenizer-monad;Break at the current position and discard the scanned tokenLtokenizer-monad)Have I reached the end of the input text?Mtokenizer-monad,Proceed as long as a given function succeedsNtokenizer-monadJProceed as long as a given fold returns Just (generalization of walkWhile)Otokenizer-monadBRepeat a given tokenizer as long as the end of text is not reachedPtokenizer-monad4Split a string into tokens using the given tokenizerQtokenizer-monadLSplit a string into tokens using the given tokenizer, case sensitive versionCDEFGHIJKLMNOPQCPQOHLDEFIMNJKGSaferQRtokenizer-monad=Tokenizer monad. Use runTokenizer or runTokenizerCS to run itStokenizer-monad9Check if the next input chars agree with the given stringTtokenizer-monadProceed to the next characterUtokenizer-monadEWalk back to the previous character, unless it was discarded/emitted.Vtokenizer-monad.Restore the state after the last emit/discard.Wtokenizer-monadPeek the current characterXtokenizer-monad&Peek the current character and proceedYtokenizer-monad8Break at the current position and emit the scanned tokenZtokenizer-monad;Break at the current position and discard the scanned token[tokenizer-monad)Have I reached the end of the input text?\tokenizer-monad,Proceed as long as a given function succeeds]tokenizer-monadJProceed as long as a given fold returns Just (generalization of walkWhile)^tokenizer-monadBRepeat a given tokenizer as long as the end of text is not reached_tokenizer-monad4Split a string into tokens using the given tokenizer`tokenizer-monadLSplit a string into tokens using the given tokenizer, case sensitive versionRSTUVWXYZ[\]^_`R_`^W[STUX\]YZVSafeatokenizer-monad=Tokenizer monad. Use runTokenizer or runTokenizerCS to run itbtokenizer-monad9Check if the next input chars agree with the given stringctokenizer-monadProceed to the next characterdtokenizer-monadEWalk back to the previous character, unless it was discarded/emitted.etokenizer-monad.Restore the state after the last emit/discard.ftokenizer-monadPeek the current charactergtokenizer-monad&Peek the current character and proceedhtokenizer-monad8Break at the current position and emit the scanned tokenitokenizer-monad;Break at the current position and discard the scanned tokenjtokenizer-monad)Have I reached the end of the input text?ktokenizer-monad,Proceed as long as a given function succeedsltokenizer-monadJProceed as long as a given fold returns Just (generalization of walkWhile)mtokenizer-monadBRepeat a given tokenizer as long as the end of text is not reachedntokenizer-monad4Split a string into tokens using the given tokenizerotokenizer-monadLSplit a string into tokens using the given tokenizer, case sensitive versionabcdefghijklmnoanomfjbcdgklhiep      !"#$%&'()*     %&+     %&+     %&     %&     %&,.tokenizer-monad-0.2.2.0-A8u5j6jHpKhJ1s6X82rQryControl.Monad.Tokenizer.ClassControl.Monad.Tokenizer$Control.Monad.Tokenizer.Char8.Strict"Control.Monad.Tokenizer.Char8.LazyControl.Monad.Tokenizer.String!Control.Monad.Tokenizer.Text.Lazy#Control.Monad.Tokenizer.Text.StrictMonadTokenizerwalkwalkBackpeekrestoreemitdiscardisEOT lookAheadpop Tokenizabletnulltheadttailttaketdroptlower walkWhilewalkFolduntilEOT$fTokenizable[]$fTokenizableText$fTokenizableText0 Tokenizerembedembed_discardAndEmbedconvert convertWith runTokenizerrunTokenizerCS$fMonadTokenizerTokenizer$fMonadTokenizer$fApplicativeTokenizer$fFunctorTokenizer$fTokenizableByteString