defog-ai / sql-eval

Evaluate the accuracy of LLM generated outputs
Apache License 2.0
540 stars 56 forks source link

Rishabh/sqlite fixes #195

Closed rishsriv closed 3 months ago

rishsriv commented 3 months ago

Fixed some questions. Also an additional prompt for the LoRA models to deal with the loss of attention with LoRA models, and be better aligned with the prompt used while training.

This is a temporary solution until our LoRA models are trained with the same prompt as our current prompt_cot.md