TypedFlow.Layers.RNN

Types

type RnnCell t states input output

type RnnLayer b n state input t output u

Combinators

stackRnnCells

(.-.)

stackRnnLayers

(.--.)

bothRnnLayers

(.++.)

withBypass

onStates

timeDistribute

timeDistribute'

RNN Cells

cellInitializerBit

data LSTMP t n x

lstm

data GRUP t n x

gru

RNN unfolding functions

rnn

rnnBackward

rnnBackwardsWithCull

rnnWithCull

Attention mechanisms

Scoring functions

type AttentionScoring t batchSize keySize valueSize nValues

multiplicativeScoring

data AdditiveScoringP sz keySize valueSize t

additiveScoring

Attention functions

type AttentionFunction t batchSize keySize valueSize

uniformAttn

luongAttention

Attention combinators

attentiveWithFeedback