search

JiaquanYe / TableMASTER-mmocr

2nd solution of ICDAR 2021 Competition on Scientific Literature Parsing, Task B.
Apache License 2.0
430 stars 103 forks source link

structure recognition accuracy is ~0.78，teds score is ~0.967，why？Is it reasonable？ #12

Closed smartshuhui closed 3 years ago

JiaquanYe commented 3 years ago

0.78 is structure recognition word accuracy. TEDS is metric measures both the structure similarity and the cell content similarity between the prediction and the ground truth. You find the details is this repo

smartshuhui commented 3 years ago

@JiaquanYe Ok, i get it, 0.78 is word acc, it seems more reasonable. Thanks!

delveintodetail commented 3 years ago

@JiaquanYe Ok, i get it, 0.78 is word acc, it seems more reasonable. Thanks!

Yes, it seems reasonable. You can get a slightly better result via model ensemble.