search

philschmid / deep-learning-pytorch-huggingface

MIT License
580 stars 138 forks source link

Cannot load tokenizer for llama2 #33

Closed smreddy05 closed 10 months ago

smreddy05 commented 10 months ago

following instructions from this tutorial (https://www.philschmid.de/instruction-tune-llama-2), I was able to download the model from hugginface but while loading tokenizer I am facing this issue

“”“OSError: Can’t load tokenizer for ‘meta-llama/Llama-2-7b-hf’. If you were trying to load it from ‘Models - Hugging Face’, make sure you don’t have a local directory with the same name. Otherwise, make sure ‘meta-llama/Llama-2-7b-hf’ is the correct path to a directory containing all relevant files for a LlamaTokenizer tokenizer. “””

any help is appreciated!

Thanks

smreddy05 commented 10 months ago

never mind, it was due to network issue :)