Text.PhonotacticLearner.PhonotacticConstraints.FileFormats

Functions for saving and loading lexicons and ClassGlob constraint grammars in standard formats.

Documentation

segmentFiero

Arguments

:: Set String

All possible segments

-> String

Raw text

-> [String]

Segmented text segmentFiero [] = error "Empty segment list."

Given a set of possible segments and a string, break a string into segments. Uses the rules in Fiero orthography (a phonetic writing system using ASCII characters) where the longest possible match is always taken and apostrophes are used as a digraph break.

joinFiero

Arguments

:: Set String

All possible segments

-> [String]

Segmented text

-> String

Raw text

Joins segments together using Fiero rules. Inserts apostrophes where necerssary.

data LexRow

Structure for reperesenting lexicon entries

Constructors

LexRow [String] Int

parseWordlist :: Set String -> Text -> [LexRow]

Parse a lexicon from a file. Segmentation of a word uses fiero rules (which will also decode space-separated segments and single-character segments). Words may optionally be followed by a tab character and an integer indicating frequency (1 by default).

collateWordlist :: Set String -> Text -> [LexRow]

Collate a list of words and frequencies from raw phonetic text.

serWordlist :: Set String -> [LexRow] -> Text

Serializes a list of words and frequerncies to a string for decoding with parseWordlist. Connects segments using Fiero rules.

serWordlistSpaced :: [LexRow] -> Text

Serializes a list of words and frequerncies to a string for decoding with parseWordlist. Puts spaces between segments.

data PhonoGrammar

Reperesentation of a ClassGlob grammar.

Constructors

PhonoGrammar

Fields

• lengthDist :: Array Length Int

  Distribution of word lengths

• constraintSet :: [ClassGlob]

  Set of constraints

• weightSet :: Vec

  Set of weights in same order as constraints

Instances

Eq PhonoGrammar

Methods

(==) :: PhonoGrammar -> PhonoGrammar -> Bool

(/=) :: PhonoGrammar -> PhonoGrammar -> Bool

Show PhonoGrammar

Methods

showsPrec :: Int -> PhonoGrammar -> ShowS

show :: PhonoGrammar -> String

showList :: [PhonoGrammar] -> ShowS

NFData PhonoGrammar

Methods

rnf :: PhonoGrammar -> ()

parseGrammar :: Text -> Maybe PhonoGrammar

Parse a grammar from a file. Blank lines ans lines begining with # are ignored. The first regular line must contain a list of (Length,Int) pairs and subsequent lines must contain a weight followed by a ClassGlob.

serGrammarRules :: [ClassGlob] -> Vec -> Text

Serialize a grammar without length distribution

serGrammar :: PhonoGrammar -> Text

Serialize a grammar including length distribution