search

moses-smt / mosesdecoder

Moses, the machine translation system
http://www.statmt.org/moses
GNU Lesser General Public License v2.1
1.58k stars 779 forks source link

PROBLEM: alignment is 0. #225

Open Rexbalaeniceps opened 2 years ago

Rexbalaeniceps commented 2 years ago

hello~ Some problems have occurred in the file training.out after running the following script:

 nohup nice /data/wbxu/mosesdecoder/scripts/training/train-model.perl -root-dir train \
 -corpus /data/wbxu/wmt14/wmt14_ende/train.en-de.clean                            \
 -f de -e en -alignment grow-diag-final-and -reordering msd-bidirectional-fe \
 -lm 0:3:/data/wbxu/excute_moses/train.en-de.blm.en:8                          \
 -external-bin-dir /data/wbxu/mosesdecoder/tools >& training.out &
PROBLEM: alignment is 0.
WARNING: Model2 viterbi alignment has zero score.
Here are the different elements that made this alignment probability zero 
Source length 79 target length 100

I use the train dataset from fairseq distillation. Please tell me why those problems appeared, thanks very much~

hieuhoang commented 2 years ago

this is quite difficult to debug from an email. My advise is to figure out the exact giza++ command that is being called and drill down from there

Rexbalaeniceps commented 2 years ago

Thanks for your response~ But I cannot fully understand your advice as I am a new hand. Could you explain more detail for me , thank you very much~