withmartian / routerbench

The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
MIT License
87 stars 17 forks source link

dataset #4

Closed vthost closed 5 months ago

vthost commented 6 months ago

Hi, Is the dataset already available on huggingface, or do you load it in a special way? I get the following error when using load_dataset("withmartian/routerbench"): datasets.exceptions.DataFilesNotFoundError: No (supported) data files found in withmartian/routerbench Thank you so much already!

jacobbieker commented 5 months ago

Hi, the dataset is on huggingface, but stored in .pkl format, so huggingface doesn't automatically work with it. The recommend method for right now is to just download the files from huggingface directly and use them that way.