marian-nmt / marian-dev

Fast Neural Machine Translation in C++ - development repository
https://marian-nmt.github.io
Other
256 stars 126 forks source link

Cost nan #1010

Open mahmoudaymo opened 1 year ago

mahmoudaymo commented 1 year ago

Bug description

When training a model with guided alignment the training cost is always nan.

How to reproduce

/marian/build/marian -c $exp_dir/config.yml \ --valid-log $exp_dir/valid.log \ --log $exp_dir/train.log \ --model $exp_dir/model.npz \ --after 10e \ --guided-alignment exp_dir/corpus.align \ --guided-alignment-cost ce

Context

Add any other information about the problem here.