huggingface / evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
https://huggingface.co/docs/evaluate
Apache License 2.0
2.05k stars 259 forks source link

Add bits-per-word metric #251

Open mathemakitten opened 2 years ago

jackapbutler commented 1 year ago

Hey, I'm a research engineer working on language modelling wanting to contribute to open source. I was wondering if this is still open and if I could give it a shot? Do you have any advice or thoughts on the best way to proceed?