meta-llama / llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.
9.95k stars 1.4k forks source link

changed readme.md and parameters.json to support llama3 vllm benchmark #492

Closed wukaixingxp closed 3 weeks ago

wukaixingxp commented 3 weeks ago

What does this PR do?

To address issue 490, this PR changed readme.md and parameters.json to support llama3 on prem vllm benchmark.

Feature/Issue validation/testing

Before submitting