Meta Llama 3.1 - Githubissues

bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

https://petals.dev

MIT License

9.26k stars 526 forks source link

Open apcameron opened 4 months ago

apcameron commented 4 months ago

Please add support for the latest Meta Models https://ai.meta.com/blog/meta-llama-3-1/

tibrezus commented 4 months ago

borzunov commented 4 months ago

Hi @apcameron @tibrezus, Llama 3.1 should work now. There are peers loading it in the public swarm.