nasco2323
commented
4 years ago how to achieve this in order to solve this problem
The implementation of the file wikitable_stat.csv will allow us to choose better tables for extracting because it allows us to see on each url the number of tables which class contains:
- box (we were able to see with the tables all the tables with the box tag are irrelevant because they do not contains important informations generally used for structuring elements (photos ,text etc.. )
- nav (same with tables which contains box in their class)
- nowraplinks (containing links to other pages on the set of tables found and represented by a call to a plugin for the representation of this kind of tables in wikitext)
- others tables on all pages that do not meet any of the conditions mentioned above are relevant and we thought we would improve it further
- commit d9b01e01b35ce2f2b0a2f9d23e69863eac5f1468 0fea7923f4422a28cfb7945fde7aa53c1b1543a5 27e22a07ed0c5ce58983f129313242804386f27d
- links of wikitable_stat.csv Links of the file wikitable_stat.csv
Revision of relevance criteria in order to have better extracted better information and well structured csv files