search

meta-llama / llama3

The official Meta Llama 3 GitHub site
Other
26.46k stars 2.99k forks source link

pathway is wrong, no have tokenizer model #242

Open 12dc32d opened 3 months ago

12dc32d commented 3 months ago

Before submitting a bug, please make sure the issue hasn't been already addressed by searching through the FAQs and existing/past issues

Describe the bug

<Please provide a clear and concise description of what the bug is. If relevant, please include a minimal (least lines of code necessary) reproducible (running this will give us the same result as you get) code snippet. Make sure to include the relevant imports.>

Minimal reproducible example

<Remember to wrap the code in ```triple-quotes blocks```>

# sample code to repro the bug

Output

<Remember to wrap the output in ```triple-quotes blocks```>

<paste stacktrace and other outputs here>

Runtime Environment

Additional context Add any other context about the problem or environment here.

easybrad commented 3 months ago

same with you

JeffreyLind22 commented 3 months ago

If you could add more information about your problem, I may be able to help - I had a 'couldn't find path' issue today I had to debug

12dc32d commented 3 months ago

If you could add more information about your problem, I may be able to help - I had a 'couldn't find path' issue today I had to debug

Thank you bro. I already find the Original file and here has tokenizer model and checkpoint file. But the one more question is my tablet uses Intel integrated graphics, it can not support cuda (only nvdia can) driver. I downloaded the intel graphics driver but I don't know how to modify the code to make the llama3 model calculate on the intel graphics card. Every time it shows that cuda is required. May share any ideas as you want?

12dc32d commented 3 months ago

same with you

You may click and download the first file. It is original file include tokenizer_model, other 2 files are checkpoint_model.

JeffreyLind22 commented 3 months ago

If you could add more information about your problem, I may be able to help - I had a 'couldn't find path' issue today I had to debug

Thank you bro. I already find the Original file and here has tokenizer model and checkpoint file. But the one more question is my tablet uses Intel integrated graphics, it can not support cuda (only nvdia can) driver. I downloaded the intel graphics driver but I don't know how to modify the code to make the llama3 model calculate on the intel graphics card. Every time it shows that cuda is required. May share any ideas as you want?

This link may be helpful, and could adapt to this repository...unfortunately I'm not an expert with this stuff lol. With integrated graphics though, you may want to explore solutions like llama.cpp or ollama, as they are better at adapting to hardware, especially non-specialist graphics units.

12dc32d commented 3 months ago

Okay....thanks. My Gpu is Intel(R) UHD Graphics, this is an iGPU, all of videos resource about Intel gpu are dGPU (The famous one is Intel Arc). The Intel Arc series is Intel's recently launched high-performance graphics card series, designed to compete with NVIDIA and AMD's discrete graphics cards. Actually, what I want to ask is how to modify the llama3 code so that it can run on Intel GPU. Although I have disabled cuda on PyCharm using the statement [os.environ["CUDA_VISIBLE_DEVICES"] = ""], every time running, it prompts me that cuda is not available, instead of considering using Intel GPU. If you have solved similar problems before or have any ideas, please have a pleasant communication.

12dc32d commented 3 months ago

Okay....thanks. My Gpu is Intel(R) UHD Graphics, this is an iGPU, all of videos resource about Intel gpu are dGPU (The famous one is Intel Arc). The Intel Arc series is Intel's recently launched high-performance graphics card series, designed to compete with NVIDIA and AMD's discrete graphics cards. Actually, what I want to ask is how to modify the llama3 code so that it can run on Intel GPU. Although I have disabled cuda on PyCharm using the statement [os.environ["CUDA_VISIBLE_DEVICES"] = ""], every time running, it prompts me that cuda is not available, instead of considering using Intel GPU. If you have solved similar problems before or have any ideas, please have a pleasant communication.