Evaluation Schema + a necessary revamp

Udayraj123 commented 1 year ago

Fixes https://github.com/Udayraj123/OMRChecker/issues/89 This PR attempts to provide a generic solution for evaluation.

This is PR#1 of a chained PR. Next

Udayraj123 commented 1 year ago

@Rohan-G you can start having a look in the main files. Starting with the schema. I'll push working changes soon.

Udayraj123 commented 1 year ago

The changes include(wip list):

working evaluation code
support for 4+ types of marking schemes: default(+1, 0), negative, multi-weighted, streak-based
support for answer_key_omr.csv
(foundation) support for answer_key_omr.jpg
add range operator support
add validations for marking scheme and omr response
picking up window_width (using screeninfo)
pickup evaluation.json recursively;
added schema for all 3 jsons
use format strings in all logs
improved error messages
reduce hardcoded configs
support config.json per instance
pickup config.json recursively;
test threshold jump value
upgrade pip packages
load json error handling
separate out utils into ImageInstanceOps, ImageUtils(static methods) and InteractionUtils(static methods)
add upsc mock; refactor; create evaluation-schema

Udayraj123 / OMRChecker