issues
search
defog-ai
/
sql-eval
Evaluate the accuracy of LLM generated outputs
Apache License 2.0
448
stars
47
forks
source link
Eval script for vLLM LoRA
#171
Closed
wendy-aw
closed
3 weeks ago
wendy-aw
commented
3 weeks ago
Add script that preprocesses LoRA adapters by dropping base layer weights, then runs sql-eval on every checkpoint using the adapters
Minor: shifted print statement in api_runner