| Safe Haskell | None |
|---|
NLP.Concraft
- data Concraft = Concraft {}
- saveModel :: FilePath -> Concraft -> IO ()
- loadModel :: FilePath -> IO Concraft
- tag :: Word w => Concraft -> Sent w Tag -> [(Set Tag, Tag)]
- marginals :: Word w => Concraft -> Sent w Tag -> [WMap Tag]
- train :: (Word w, FromJSON w, ToJSON w) => Tagset -> Int -> TrainConf -> TrainConf -> IO [Sent w Tag] -> IO [Sent w Tag] -> IO Concraft
- reAnaTrain :: (Word w, FromJSON w, ToJSON w) => Tagset -> Analyse w Tag -> Int -> TrainConf -> TrainConf -> IO [SentO w Tag] -> IO [SentO w Tag] -> IO Concraft
- prune :: Double -> Concraft -> Concraft
Model
Concraft data.
saveModel :: FilePath -> Concraft -> IO ()Source
Save model in a file. Data is compressed using the gzip format.
Tagging
tag :: Word w => Concraft -> Sent w Tag -> [(Set Tag, Tag)]Source
Tag sentence using the model. In your code you should probably
use your analysis function, translate results into a container of
Sentences, evaluate tag on each sentence and embed the
tagging results into the morphosyntactic structure of your own.
The function returns guessing results as fst elements
of the output pairs and disambiguation results as snd
elements of the corresponding pairs.
marginals :: Word w => Concraft -> Sent w Tag -> [WMap Tag]Source
Determine marginal probabilities corresponding to individual tags w.r.t. the disambiguation model. Since the guessing model is used first, the resulting weighted maps may contain tags not present in the input sentence.
Training
Arguments
| :: (Word w, FromJSON w, ToJSON w) | |
| => Tagset | Tagset |
| -> Int | Numer of guessed tags for each word |
| -> TrainConf | Guessing model training configuration |
| -> TrainConf | Disamb model training configuration |
| -> IO [Sent w Tag] | Training data |
| -> IO [Sent w Tag] | Evaluation data |
| -> IO Concraft |
Train guessing and disambiguation models. No reanalysis will be performed.
Arguments
| :: (Word w, FromJSON w, ToJSON w) | |
| => Tagset | Tagset |
| -> Analyse w Tag | Analysis function |
| -> Int | Numer of guessed tags for each word |
| -> TrainConf | Guessing model training configuration |
| -> TrainConf | Disamb model training configuration |
| -> IO [SentO w Tag] | Training data |
| -> IO [SentO w Tag] | Evaluation data |
| -> IO Concraft |
Train guessing and disambiguation models after dataset reanalysis.