EricFillion / happy-transformer

Happy Transformer makes it easy to fine-tune and perform inference with NLP Transformer models.
http://happytransformer.com
Apache License 2.0
516 stars 66 forks source link

wanted to use GLUE score or perplexity in the model evaluation. #308

Open syogeeshwari opened 1 year ago

syogeeshwari commented 1 year ago

Is it possible to change the metrics from loss?

EricFillion commented 1 year ago

No not yet, eventually it'll be possible.

syogeeshwari commented 1 year ago

Thanks for the reply