Closed gpengzhi closed 1 year ago
Another question:
When you apply self-training objective, the alignment matrix A is not the bpe-level intersection 0-1 matrix(?) The alignment matrix A you used is actually the word-level alignment 0-1 matrix converted from the bpe-level intersection matrix. It that correct?
Thanks for the questions!
why is the entry pointed out to be one?
this is because some entries got rounded down to 0 in the visualization but they are actually greater than the threshold (i.e. they are in the range [0.001, 0.005]).
the alignment matrix A
correct. I remembered that I found using word-level alignment is better for most language pairs.
In the intersection matrix, why is the entry pointed out to be one?
Do I miss some technical details?
Thanks a lot!