search

instructlab / sdg

Python library for Synthetic Data Generation
https://pypi.org/project/instructlab-sdg/
Apache License 2.0
23 stars 36 forks source link

fix: change "group" to "tag" for mmlu_branch task config #305

Closed alimaredia closed 1 month ago

alimaredia commented 1 month ago

"group" is being deprecated in the task config as of lm-eval version 0.4.4. "tag" should be used instead.

For more information see "Backwards Incompatibilities" at: https://github.com/EleutherAI/lm-evaluation-harness/releases/tag/v0.4.4

nathan-weinberg commented 1 month ago

@Mergifyio backport release-v0.4

mergify[bot] commented 1 month ago

backport release-v0.4

✅ Backports have been created

* [#308 fix: change "group" to "tag" for mmlu_branch task config (backport #305)](https://github.com/instructlab/sdg/pull/308) has been created for branch `release-v0.4`