NLP.Nerf.Dict.Base

Basic types for dictionary handling.

Lexicon entry

type Form = Text

A orthographic form.

isMultiWord :: Form -> Bool

Is the form a multiword one?

type NeType = Text

A type of named entity.

data Entry

A Named Entity entry from the LMF dictionary.

Constructors

Entry

Fields

neOrth :: !Form

Orthographic form of the NE

neType :: !NeType

Type of the NE

Instances

Eq Entry

Ord Entry

Read Entry

Show Entry

Dictionary

type NeDict = Map Form (Set NeType)

A NeDict is a map from forms to NE types. Each NE may be annotated with multiple types.

mkDict :: [Entry] -> NeDict

Construct the dictionary from the list of entries.

siftDict :: (Form -> Set NeType -> Bool) -> NeDict -> NeDict

Remove dictionary entries which do not satisfy the predicate.

saveDict :: FilePath -> NeDict -> IO ()

Save the dictionary in the file.

loadDict :: FilePath -> IO NeDict

Load the dictionary from the file.

Merging dictionaries

merge :: [NeDict] -> NeDict

Merge dictionary resources.

diff :: [NeDict] -> [NeDict]

Differentiate labels from separate dictionaries using dictionary-unique prefixes.