Add lora arguments to README for setting up vllm server

defog-ai / sql-eval

Evaluate the accuracy of LLM generated outputs

Apache License 2.0

448 stars 47 forks source link

Add lora arguments to README for setting up vllm server #194

Closed rishsriv closed 1 week ago

rishsriv commented 1 week ago

Thanks both! JP I think Wendy's run_models_adapter.sh covers the adapters use-case, so will leave this as it is for now! In the near future, would love to just change the default to a single script by modifying Wendy's script!

wongjingping commented 1 week ago

oh yes thanks for reminding me of wendy's script! that'll do 👍🏼