Stability-AI / lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.
MIT License
143 stars 47 forks source link

Please consider providing bibliographic information #120

Open s-mizuki-nlp opened 8 months ago

s-mizuki-nlp commented 8 months ago

I really appreciate your contribution and dedication to advancing large-scale language modeling in Japanese.

Would you kindly provide the bibliographic infromation of the JP Language Model Evaluation Harness ("framework" hereafter)? Our team, tokyotech-llm, has utilized your framework into our research and development project of the LLM and wishes to acknowledge it in our academic papers and other publications. While we currently cite the GitHub repository URL, we prefer to credit the contributors appropriately. If possible, we'd appreciate the bibliographic information, ideally in bibtex format.

For your information, the official Language Model Evaluation Harness releases their citation details on Zenodo after major updates.

leemengtw commented 8 months ago

Hi @s-mizuki-nlp thanks for reaching out and the kind words. Since some of our team members are in vacation, we will provide bibliographic info and update the repo README later and let you know when it's ready in this issue, thanks!