search

jondurbin / bagel

A bagel, with everything.
300 stars 31 forks source link

[BUG] cais/mmlu changed format #10

Open Dakraid opened 4 months ago

Dakraid commented 4 months ago

cais/mmlu seemed to have recently changed the format of their dataset, so the split on "auxiliary_train" and selection range of 50000 does not work anymore. Adjustments to the Python script for mmlu are required.

https://huggingface.co/datasets/cais/mmlu