Add translation datasets and summarization datasets.
Please drop the evaluation_datasets.tar.gz to lm_eval/tasks/yanolja/data.
If you want to evaluate translation, give tasks as yanolja_translation
If you want to evaluate summarization, give tasks as yanolja_summarization
If you want to evalutate english & korean perplexity, give tasks as yanolja_perplexity
P.S. There is a issue on yaonlja_review_summarization.yaml, I'm fixing it right now.
Add translation datasets and summarization datasets.
Please drop the evaluation_datasets.tar.gz to
lm_eval/tasks/yanolja/data.If you want to evaluate translation, give tasks as
yanolja_translationIf you want to evaluate summarization, give tasks asyanolja_summarizationIf you want to evalutate english & korean perplexity, give tasks asyanolja_perplexityP.S. There is a issue on yaonlja_review_summarization.yaml, I'm fixing it right now.