defog-ai / sql-eval

Evaluate the accuracy of LLM generated outputs
Apache License 2.0
485 stars 52 forks source link

Added ability to get logprobs from vllm API results, and see them visualized in another repo #142

Closed rishsriv closed 2 months ago

rishsriv commented 2 months ago

Please refer to https://github.com/defog-ai/eval-visualizer/ for details on how this can be used to visualized sql-eval