Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama for WhatsApp & Messenger.
Please describe the tests that you ran to verify your changes and relevant result summary. Provide instructions so it can be reproduced.
Please also list any relevant details for your test configuration.
[ ] Test A
Logs for Test A
[ ] Test B
Logs for Test B
Before submitting
[ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
What does this PR do?
Fixes # (issue)
Feature/Issue validation/testing
Please describe the tests that you ran to verify your changes and relevant result summary. Provide instructions so it can be reproduced. Please also list any relevant details for your test configuration.
[ ] Test A Logs for Test A
[ ] Test B Logs for Test B
Before submitting
Thanks for contributing 🎉!