issues
search
ChatWithPDF
/
ai-tools
AI Tooling to bootstrap applications fast
1
stars
0
forks
source link
Eval Score
#5
Closed
ChakshuGautam
closed
8 months ago
ChakshuGautam
commented
9 months ago
[x] 20 Questions on a PDF that we don't train for => 20 Answers; Compare that against our answers -
Eval Document
[ ] Improve tagging of Questions - @GautamR-Samagra
[ ] Update the marking scheme to show 0.5 when it says it cannot answer a question - @aashutosh-samagra ; Answering wrongly is -1.
[ ] API to compare responses - @GautamR-Samagra
[ ] Add this to CI to see improvement on scores - @Amruth-Vamshi