Right-to-left processing of sentences

senarvi / theanolm

TheanoLM is a recurrent neural network language modeling tool implemented using Theano

Apache License 2.0

81 stars 29 forks source link

Right-to-left processing of sentences #20

Closed Waino closed 5 years ago

Waino commented 7 years ago

Allow a command line flag to change the direction in which sentences are read to backwards/right-to-left. This flag should apply to both training and scoring.

Currently TheanoLM only operates in left-to-right mode. For certain tasks, e.g. rescoring, it is preferable to score sentences separately in both directions and then combine the scores.

senarvi commented 7 years ago

Would bidirectional LSTM have the same performance?