Open gregtatum opened 1 month ago
Nonsense translation:
US Election Unspun -> JAV rinkimai „Uns“ US Election Unspun -> JAV rinkimai „Unsup“
This may be the result of passthrough translations, or maybe just short translations.
There's a whole bunch more of them here:
https://elk.zone/fosstodon.org/@KasTasMykolas@river.group.lt/112812259518762235
@gregtatum I believe it's kind of a duplicate of #231. The root issue is that the distilled model has low scores and everything else follows. It doesn't mean all the issues will be fixed though.
This issue can serve as a place for specific Lithuanian feedback, and outside contributors could add examples here as well if they wish.
Teacher ensemble was 0.8971 COMET (-1.07%), but then quantized student was 0.8598 (-5.45%). I asked online for qualitative feedback on how our models are performing and received feedback that it wasn't very good.
Word inventions:
Then an issue with gender: