Conllu.Parse

Parsers for CoNLL-U format. the CoNLL-U format is based in the deprecated CoNLL format (defined here) and is defined here

Documentation

type Parser = Parsec Void String

Parser type synonym

parsers

parseConlluWith

Arguments

:: Parser Sent

the sentence parser to be used.

-> FilePath

the source whose stream is being supplied in the next argument (may be "" for no file)

-> String

stream to be parsed

-> Either String Doc

parse a CoNLL-U document using a customized parser.

parseConllu :: FilePath -> String -> Either String Doc

parse a CoNLL-U document using the default parser.

customizable parsers

data ParserC

Constructors

ParserC (Parser Comment) (Parser ID) (Parser FORM) (Parser LEMMA) (Parser UPOS) (Parser XPOS) (Parser FEATS) (Parser DEPREL) (Parser DEPS) (Parser MISC)

parserC :: ParserC -> Parser Sent

defines a custom parser of sentences. if you only need to customize one field parser (e.g., to parse special comments or a special MISC field), you can do:

parserC ParserC{_commentP = myCommentsParser }

default parsers

rawSents :: Parser (RawData String Void)

parse CoNLL-U sentences with recovery.

sentence :: Parser Sent

the default sentence parser.

comment :: Parser Comment

parse a comment.

word :: Parser (CW AW)

the default word parser.

CoNLL-U field parsers

emptyField :: Parser (Maybe a)

parse an empty field.

idW :: Parser ID

parse the ID field, which might be an integer, a range, or a decimal.

form :: Parser FORM

parse the FORM field.

lemma :: Parser LEMMA

parse the LEMMA field.

upos :: Parser UPOS

parse the UPOS field.

xpos :: Parser XPOS

parse the XPOS field.

feats :: Parser FEATS

parse the FEATS field.

deprel :: Parser DEPREL

parse the DEPREL field.

deps :: Parser DEPS

parse the DEPS field.

misc :: Parser MISC

parse the MISC field.

utility parsers

commentPair :: Parser Comment

parse a comment pair.

listPair :: String -> Parser a -> Parser b -> Parser [(a, b)]

parse a list of pairs.

stringNot :: String -> Parser String

parse any chars except the ones provided.

stringWOSpaces :: Parser String

parse a string until a space, a tab, or a newline.

stringWSpaces :: Parser String

parse a string until a tab or a newline.

parser combinators

keyValue :: String -> Parser a -> Parser b -> Parser (a, b)

parse a (key, value) pair.

maybeEmpty :: Parser a -> Parser (Maybe a)

a parser combinator for parsers that won't parse "_" (e.g., as lemma would).

two combinators are needed for parsing the empty field (without lookahead). this has to do with the fact that if we do

form <|> emptyField

we would parse "_" as a non-empty FORM field. but if we did

emptyField <|> form

we would parse "_" in "_something" and then the parser would choke expecting a tab.

orEmpty :: Parser String -> Parser (Maybe String)

a parser combinator for parsers that may parse "_".

listP :: Parser [a] -> Parser [a]

parse a list of values that may be an empty field. using a parser that returns a possibly empty list like sepBy and many will return the correct result for the empty field ('_'), but will report it the same as any other syntax error.