search

boun-tabi-LMG / turkish-lm-tuner

Turkish LM Tuner
https://boun-tabi-lmg.github.io/turkish-lm-tuner/
MIT License
76 stars 6 forks source link

Separate inference script #14

Closed zeynepyirmibes closed 9 months ago

zeynepyirmibes commented 10 months ago

We need to write a separate inference script that evaluates a fine-tuned model.

Currently, we do training and evaluation with the train_and_evaluate function in finetune.py, but there are some datasets that have external or multiple test sets. Therefore, it will be more useful to be able to make inference externally. In addition, it will make it easier to prepare and test the postprocess and compute_metrics functions for each dataset.

zeynepyirmibes commented 9 months ago

Changes were added with PR #15.