search

Alpha-VLLM / LLaMA2-Accessory

An Open-source Toolkit for LLM Development
https://llama2-accessory.readthedocs.io/
Other
2.7k stars 170 forks source link

tokenizer.model not found #107

Closed axin1301 closed 10 months ago

axin1301 commented 10 months ago

Hi, thank you for your amazing work. I am new to the LLaMA, and I tried to run inference.py in SPHINX. However, I cannot find the tokenizer.model in your repository. Could you please provide any information where I can find it? Thank you.

gaopengpjlab commented 10 months ago

tokenizer.model is provided by the original llama download package. Please download it using the methods provided by llama repo.