Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama for WhatsApp & Messenger.
System Info
-
Information
🐛 Describe the bug
Would be great to get expedited access to the Llama2 model family, my request has been sitting for a few hours now https://huggingface.co/meta-llama/Llama-2-7b-hf
Error logs
-
Expected behavior
-