Given sourceText, a model is tasked to generate mtText or targetText. If the model assigns a higher likelihood on targetText (gold translation), it is treated as correct, such that we could measure the acc (accuracy).
An example entry is like
"sourceText": "한국을 바라보는 미국 드라마와 영화 업계의 반응이 그리 나쁘지 않은 것도 호재다.",
"mtText": "Another positive factor is that the response of the American drama and film industry to Korea is not so bad.",
"targetText": "Another positive factor is that the response of the U.S. drama and film industry regarding Korea is not so bad.",
Question: Is it the right way to merge this PR into the main?
/data/shared/datasets/translation_evaluation/aihub_translation_mtpe_filtered_valid_ko-en.jsonlsourceText, a model is tasked to generatemtTextortargetText. If the model assigns a higher likelihood ontargetText(gold translation), it is treated as correct, such that we could measure theacc(accuracy).An example entry is like
Question: Is it the right way to merge this PR into the main?