AlibabaResearch / DAMO-ConvAI

DAMO-ConvAI: The official repository which contains the codebase for Alibaba DAMO Conversational AI.
MIT License
1.08k stars 176 forks source link

Loading problem with API-BANK dataset on huggingface dataset -- ValueError: Couldn't cast #111

Closed Octobrist closed 6 months ago

Octobrist commented 7 months ago

My solution is written below, but this can not load the level-3 test dataset , I hope the author put forward a better method. https://huggingface.co/datasets/liminghao1630/API-Bank/discussions/1

liminghao1630 commented 6 months ago

In fact, we only use huggingface to host the datasets, and do not support the use of the datasets library to load.

paridhimaheshwari2708 commented 5 months ago

@Octobrist How did you load the remaining training and test dataset (excluding level-3 test) from Huggingface? @liminghao1630 If huggingface isn't supported, then could you share the code to load training and test data from local files?