search

zzzDavid / ICDAR-2019-SROIE

ICDAR 2019 Robust Reading Challenge on Scanned Receipts OCR and Information Extraction
MIT License
384 stars 132 forks source link

How to evaluate the JSON dump created by the task3/src/test.py ? #18

Closed xssChauhan closed 3 years ago

xssChauhan commented 3 years ago

Readme of the repo mentions the metrics on task 3.

The test.py for task3 only outputs the json dump of entities extracted. How can I get the metrics on the test data?

Also since the test_dict.pth only contains the text strings and not the actual labels.

xssChauhan commented 3 years ago

For future reference: Test set annotations are not publicly available.

For evaluation, a zip file of json dumps has to be uploaded here: https://rrc.cvc.uab.es/?ch=13&com=mymethods&task=1.