search

bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
https://petals.dev
MIT License
9.06k stars 505 forks source link

Meta Llama 3.1 #597

Open apcameron opened 1 month ago

apcameron commented 1 month ago

Please add support for the latest Meta Models https://ai.meta.com/blog/meta-llama-3-1/

tibrezus commented 1 month ago

UP

borzunov commented 1 month ago

Hi @apcameron @tibrezus, Llama 3.1 should work now. There are peers loading it in the public swarm.