Closed Asafgendler closed 1 year ago
Yes. Check these:
Paragraph loss mask: https://github.com/tensorflow/models/blob/1879fa0c7f59b89f08abb89826e919d5ed4dd9ce/official/projects/unified_detector/modeling/universal_detector.py#L826
Can you explain then what is the gt_affinity_mask for? is it making the loss ignore illegible lines? or is it making the loss to ignore lines which belong to illegible paragraphs?
The latter one: it is making the loss to ignore lines which belong to illegible paragraphs (or does not have a paragraph label)
Thanks for the clarification, So two follow-up questions.
A1: It's up to the annotator's decision; Sometimes it's because it's too dense and messy.
A2: Illegible paragraphs means this paragraph group might be a merge of multiple groups i.e. the annotators did not annotate the paragraph labels for these lines. Paragraph vertices are not meant to be accurate. Annotators annotate paragraph grouping by drawing polygons. Lines falling into the same polygon belong to the same group. So, these vertices do not represent the paragraph shape. They are only used to group the lines.
Thank you very much
Hey, thanks for the great dataset.
I wanted to ask if you use the illegible paragraphs when training the line grouping head (the layout branch), or are those paragraphs ignored.