search

togethercomputer / OpenChatKit

Apache License 2.0
9.01k stars 1.02k forks source link

NotImplementedError: Loading a streaming dataset cached in a LocalFileSystem is not supported yet. #174

Open jingli-wtbox opened 8 months ago

jingli-wtbox commented 8 months ago

Error

when i run below command,

bash training/finetune_llama-2-7b-32k-mqa.sh

it will return errors:

NotImplementedError: Loading a streaming dataset cached in a LocalFileSystem is not supported yet.

How-to-Fix

re-install datasets old version: 2.13.0 (above error) new version: 2.15.0 (working)