search

SafeAILab / EAGLE

Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)
https://arxiv.org/pdf/2406.16858
Apache License 2.0
780 stars 79 forks source link

OSError when download weights from huggingface #18

Closed ZepinLi closed 9 months ago

ZepinLi commented 9 months ago

OSError: Can't load tokenizer for 'yuhuili/EAGLE-llama2-chat-7B'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'yuhuili/EAGLE-llama2-chat-7B' is the correct path to a directory containing all relevant files for a LlamaTokenizerFast tokenizer.

ZepinLi commented 9 months ago

Note: i followed the pipeline of transformers to download EAGLE team's open source trained weights, but failed due to OSError of tokenizer. do you know why? much appreciation.

Liyuhui-12 commented 9 months ago

Did you use transformers.pipeline? Currently, EAGLE cannot be used in that way. You can follow the instructions in the Readme to use EAGLE.

ZepinLi commented 9 months ago

I try download from huggingface page manually, and it worked. I'll try with writing code later. thx!