fine-tune vram cost - Githubissues

openlm-research / open_llama

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

Apache License 2.0

7.27k stars 370 forks source link

Open anthony030477 opened 11 months ago

anthony030477 commented 11 months ago

If I want to fine-tune llama 3B_v2, how much vram will I need?