Is it normal that with standard bleu settings if an n_gram isn't in references then the score returned is 0 ?
With default settings (4 n_grams and weights = [0.025] *4)
The candidate : ['Le', 'petit', 'chat', 'moche']
For the reference : ['Le', 'petit', 'chat', 'mignon']
Get a bleu score of 0.
Due to this line in the code :
if min(clipped_counts) == 0:
return 0.0
❓ Questions and Help
Is it normal that with standard bleu settings if an n_gram isn't in references then the score returned is 0 ?
With default settings (4 n_grams and weights = [0.025] *4) The candidate : ['Le', 'petit', 'chat', 'moche'] For the reference : ['Le', 'petit', 'chat', 'mignon'] Get a bleu score of 0.
Due to this line in the code : if min(clipped_counts) == 0: return 0.0
Is this behaviour normal ?