search

IndoNLP / nusa-writes

NusaWrites is an in-depth analysis of corpora collection strategy and a comprehensive language modeling benchmark for underrepresented and extremely low-resource Indonesian local languages.
Apache License 2.0
25 stars 2 forks source link

Fix bugs found in run.sh, run_generation.sh, and run_lolo.sh during checking #10

Closed holylovenia closed 1 year ago

holylovenia commented 1 year ago

For details, see commit messages. Performances have been reported in the sheets for comparison.

holylovenia commented 1 year ago

By the way, I have uncommented the comments and also updated the requested results in the sheets. Also, during the inspection, I also found that running the fine-tuning with fp16 would cause nan loss.

SamuelCahyawijaya commented 1 year ago

@holylovenia : Thank you for inspecting the code and the experiment. We can discuss the result further on the next meeting. Thank you!