google-research-datasets / hiertext

The HierText dataset contains ~12k images from the Open Images dataset v6 with large amount of text entities. We provide word, line and paragraph level annotations.
Creative Commons Attribution Share Alike 4.0 International
264 stars 24 forks source link

Evaluation on Test Set isn't working #22

Open gaurav-g-12 opened 4 days ago

gaurav-g-12 commented 4 days ago

I’m having trouble uploading my test set JSON file on https://rrc.cvc.uab.es/?ch=18 for evaluation, as it returns an error during result calculation. I even tried using the sample output file provided on the website, but that also failed to upload. Could you suggest a solution to resolve this issue? Thank you!

Jyouhou commented 4 days ago

Is it the same issue as https://github.com/google-research-datasets/hiertext/issues/21?

gaurav-g-12 commented 4 days ago

Is it the same issue as #21?

yes, initially for 2 minutes it shows "The method is being calculated", after which it giving "The method has produced an error when calculating: Default - Paragraph PQ, Default - Line PQ"

gaurav-g-12 commented 4 days ago
image
ShashankKrishnaV commented 4 days ago

This is the same issue I am also facing from last few days.

gaurav-g-12 commented 1 day ago

When this is expected to be fixed?

mavi-iitd commented 1 day ago

Yeah, pls fix the issue as it is really urgent to put it in my CVPR paper.