NLP.Chunk.AvgPerceptronChunker

Avegeraged Perceptron Chunker

Documentation

mkChunker :: (ChunkTag c, Tag t) => Perceptron -> Chunker c t

Create a chunker from a Perceptron.

trainInt

Arguments

:: (ChunkTag c, Tag t)

=> Int

The number of times to iterate over the training data, randomly shuffling after each iteration. (5 is a reasonable choice.)

-> Perceptron

The Perceptron to train.

-> [ChunkedSentence c t]

The training data. (A list of [(Text, Tag)]'s)

-> IO Perceptron

A trained perceptron. IO is needed for randomization.

chunk :: (ChunkTag c, Tag t) => Perceptron -> [TaggedSentence t] -> [ChunkedSentence c t]

Chunk a list of POS-tagged sentence, generating a parse tree.

chunkSentence :: (ChunkTag c, Tag t) => Perceptron -> TaggedSentence t -> ChunkedSentence c t

Chunk a single POS-tagged sentence.

data Chunker c t

The type of Chunkers, incorporates chunking, training, serilazitaion and unique IDs for deserialization.

Constructors

Chunker

Fields

chChunker :: [TaggedSentence t] -> [ChunkedSentence c t]

chTrainer :: [ChunkedSentence c t] -> IO (Chunker c t)

chSerialize :: ByteString

chId :: ByteString

chunkerID :: ByteString

The unique ID for this implementation of a Chunker

readChunker :: (ChunkTag c, Tag t) => ByteString -> Either String (Chunker c t)

deserialize an AvgPerceptronChunker from a ByteString.