Memory footprints (GB) of Llama-3.1-8B, Llama-3.1-70B, Llama-3.1-405B, Llama-3-8B, Llama-3-70B models and hardware specifications required to run the models

meta-llama / llama3

The official Meta Llama 3 GitHub site

Other

25.97k stars 2.91k forks source link

Memory footprints (GB) of Llama-3.1-8B, Llama-3.1-70B, Llama-3.1-405B, Llama-3-8B, Llama-3-70B models and hardware specifications required to run the models #280

Open Rumeysakeskin opened 1 month ago

Rumeysakeskin commented 1 month ago

What are the memory footprints (GB) of

Llama-3.1-8B
Llama-3.1-70B
Llama-3.1-405B
Llama-3-8B
Llama-3-70B

models and hardware specifications required to run the models?

CodeMagic6 commented 1 month ago

What are the memory footprints (GB) of
* Llama-3.1-8B

* Llama-3.1-70B

* Llama-3.1-405B

* Llama-3-8B

* Llama-3-70B
models and hardware specifications required to run the models?

personal PC use 8B.,memory needs 16gb-32gb. enterprise computer use 70B, 405B