search

thu-coai / cotk

Conversational Toolkit. An Open-Source Toolkit for Fast Development and Fair Evaluation of Text Generation
Apache License 2.0
128 stars 26 forks source link

[BUG] don't use whole reference array, sample some of them #357

Closed hzhwcmhf closed 4 years ago

hzhwcmhf commented 4 years ago

https://github.com/thu-coai/cotk/blob/master/cotk/metric/bleu.py#L406

hzhwcmhf commented 4 years ago

https://github.com/thu-coai/cotk/blob/master/cotk/metric/bleu.py#L385-L386

use a length instead two different lengths

hzhwcmhf commented 4 years ago

hash version changed

hzhwcmhf commented 4 years ago

SelfBleu FwBwBleu use multiprocess when sample > 100 <--- class variable

hzhwcmhf commented 4 years ago

done