search

namtuanly / MTL-TabNet

MTL-TabNet: Multi-task Learning based Model for Image-based Table Recognition
Apache License 2.0
78 stars 12 forks source link

[Question] How can I run the evaluation for the custom data? #14

Open aashishpokharel opened 3 months ago

aashishpokharel commented 3 months ago

Hi I just want to run a evaluation for my custom data, But documentation for calculation of the TEDS score is vague and couldn't carry out the process?

  1. Do I have to run the inference before running the evaluation?
  2. If so, do I need to make changes to the data?
namtuanly commented 1 month ago

Hi, I am sorry for the late reply. The following are the answers to your questions.

  1. Yes, you have to run the inference before running the evaluation or you can merge these two files in to one for convenience.
  2. Yes, you need to make the annotation format to same with PubTabNet. You can refer to the code in https://github.com/namtuanly/WikiTableSet/blob/main/HTMLTable2Image/wiki_table_parser_en.py for making the PubTabNet annotation.