NLP.Nerf.Dict.Base

Basic types for dictionary handling.

Lexicon entry

type NeType = Text

A type of named entity.

type Form = Text

A orthographic form.

isMultiWord :: Form -> Bool

Is the form a multiword one?

data Entry

A Named Entity entry from the LMF dictionary.

Constructors

Entry

Fields

• neOrth :: !Form

  Orthographic form of the NE

• neType :: !NeType

  Type of the NE

Instances

Eq Entry

Defined in NLP.Nerf.Dict.Base

Methods

(==) :: Entry -> Entry -> Bool

(/=) :: Entry -> Entry -> Bool

Ord Entry

Defined in NLP.Nerf.Dict.Base

Methods

compare :: Entry -> Entry -> Ordering

(<) :: Entry -> Entry -> Bool

(<=) :: Entry -> Entry -> Bool

(>) :: Entry -> Entry -> Bool

(>=) :: Entry -> Entry -> Bool

max :: Entry -> Entry -> Entry

min :: Entry -> Entry -> Entry

Read Entry

Defined in NLP.Nerf.Dict.Base

Methods

readsPrec :: Int -> ReadS Entry

readList :: ReadS [Entry]

readPrec :: ReadPrec Entry

readListPrec :: ReadPrec [Entry]

Show Entry

Defined in NLP.Nerf.Dict.Base

Methods

showsPrec :: Int -> Entry -> ShowS

show :: Entry -> String

showList :: [Entry] -> ShowS

Dictionary

type Label = Text

Dictionary label.

type DAWG = DAWG Trans Char ()

A Dict is a map from forms to labels. Each form may be annotated with multiple labels. The map is represented using the directed acyclic word graph. type Dict = D.DAWG (S.Set Label)

type Dict = DAWG (Set Label)

fromPairs :: [(Form, Label)] -> Dict

Construct dictionary from the list of form/label pairs.

fromEntries :: [Entry] -> Dict

Construct dictionary from the list of entries.

siftDict :: (Form -> Set Label -> Bool) -> Dict -> Dict

Remove dictionary entries which do not satisfy the predicate.

saveDict :: FilePath -> Dict -> IO ()

Save the dictionary in the file.

loadDict :: FilePath -> IO Dict

Load the dictionary from the file.

Merging dictionaries

merge :: [Dict] -> Dict

Merge dictionary resources.

diff :: [Dict] -> [Dict]

Differentiate labels from separate dictionaries using dictionary-unique prefixes.