wangwen-whu / WTW-Dataset

This is an official implementation for the WTW Dataset in "Parsing Table Structures in the Wild " on table detection and table structure recognition.
Other
152 stars 15 forks source link

How did the paper evaluate the TEDS? #12

Open BlackDriver opened 2 years ago

BlackDriver commented 2 years ago

When I do my sub-category experiment in the sub-categories in WTW, because there may be more than one table in a single image, I tried to assemble the sub-cate result in your paper to find out the TEDS are calculated per image or per table, but both ways not matched the TEDS score of the whole test set.

我在做子类别实验的时候,因为一幅图里可能有几张表,所以我想知道你们论文的子类别实验到底是 TEDS/每图 还是 TEDS/每表,但是我用子类别TEDS指标加起来算总指标的时候,两种方式都对不上,所以我想知道你们是用什么规则计算TEDS的,或者干脆就是我算错了。。。

我是这样算的: The formula below is my calculation method: PER IMAGE: from 'simple' to 'multicolor-grid' result = (94.293 + 90.6670 + .... + 66.7*749) /3611 = 76.17

PER TABLE: from 'simple' to 'multicolor-grid' result = (94.293 + 90.6676 + .... + 66.7*991) /4048 = 75.6

These reults not match any score in your paper What's wrong with that?Maybe I'm just stupid but please tell me the right method.

cv-small-snails commented 2 years ago

@wangwen-whu