Timeout while applying YAML to large file

usc-isi-i2 / t2wml

Table to Wikidata Mapping Language

MIT License

22 stars 11 forks source link

Timeout while applying YAML to large file #106

Closed szeke closed 4 years ago

szeke commented 4 years ago

The WGI_Data.csv in https://github.com/usc-isi-i2/t2wml-projects/tree/master/wgi is to large to apply and it times out.

The template-output filter contains the kgtk_properties.tsv file for the project, use consolidated_wikifier.csv, and also load properties from https://github.com/usc-isi-i2/datamart-schema/blob/master/properties.tsv

BTW, I have another file that is 10x larger (195M) which uses the same YAML and wikifier.

devowit commented 3 years ago

@szeke could you send us the files for this again? we're just curious to see if @g1eb 's table can handle files agGrid couldn't (not prioritizing adding support if it can't, just curious)