Create Dataset for testing: Ground Truth

Chirag2x commented 2 weeks ago

We have to create Ground truth dataset for custom sheets, so we can test the performance of custom sheets with this help of this. This requires to create the true answers for the scans that was sent by Dr. Holdener in project channel (for testing ai results). This issue would need to manually go through each sheet and generate a CSV version of the answers. You will need to set up way to compare the true answers with AI produced answers. set up a script that takes 2 Input CSV, 1 for true answer that you created and other will be output from bubble scan, compares against the true answers.

Success Criteria:

[ ] Set up the comparison scripts.
[ ] Get the output in digital format.
[ ] Then scan those with our application for accuracy.
[ ] Then compare the output with your comparison scripts.
[ ] Report the results and misses.

Data: bubble_scans_50_5.pdf

kate-holdener commented 1 week ago

This would be great for new contributors! Let's make sure we have the custom sheet format finalized before beginning this work.

Chirag2x commented 1 week ago

This would be great for new contributors! Let's make sure we have the custom sheet format finalized before beginning this work.

I wanted this to be a group activity. so this can be used to check the accuracy for the custom sheets.

oss-slu / bubble_scan

Create Dataset for testing: Ground Truth #92