NLP.Nerf.Dict.Base

Basic types for dictionary handling.

Lexicon entry

type NeType = Text

A type of named entity.

type Form = Text

A orthographic form.

isMultiWord :: Form -> Bool

Is the form a multiword one?

data Entry

A Named Entity entry from the LMF dictionary.

Constructors

Entry

Fields

neOrth :: !Form

Orthographic form of the NE

neType :: !NeType

Type of the NE

Instances

Eq Entry

Ord Entry

Read Entry

Show Entry

Dictionary

type Label = Text

Dictionary label.

type DAWG = DAWG Trans Char ()

A Dict is a map from forms to labels. Each form may be annotated with multiple labels. The map is represented using the directed acyclic word graph. type Dict = D.DAWG (S.Set Label)

type Dict = DAWG (Set Label)

fromPairs :: [(Form, Label)] -> Dict

Construct dictionary from the list of form/label pairs.

fromEntries :: [Entry] -> Dict

Construct dictionary from the list of entries.

siftDict :: (Form -> Set Label -> Bool) -> Dict -> Dict

Remove dictionary entries which do not satisfy the predicate.

saveDict :: FilePath -> Dict -> IO ()

Save the dictionary in the file.

loadDict :: FilePath -> IO Dict

Load the dictionary from the file.

Merging dictionaries

merge :: [Dict] -> Dict

Merge dictionary resources.

diff :: [Dict] -> [Dict]

Differentiate labels from separate dictionaries using dictionary-unique prefixes.