search

defog-ai / sql-eval

Evaluate the accuracy of LLM generated outputs
Apache License 2.0
485 stars 52 forks source link

Added custom api server #123

Closed wongjingping closed 2 months ago

wongjingping commented 2 months ago

Added custom api server that only returns the generated output but not the prompt to simplify the output parsing. Updated README.md with instructions. Updated gcs_eval.py with option to set NUM_BEAMS in 1 place.

rishsriv commented 2 months ago

Nice! Super convenient – thank you!!