qcif / data-curator

Data Curator - share usable open data
MIT License
265 stars 38 forks source link

Review software libraries to simplify repo #461

Open Stephen-Gates opened 6 years ago

Stephen-Gates commented 6 years ago

review use of

Stephen-Gates commented 6 years ago

Update README.md to reflect changes

ghost commented 6 years ago

Hi @Stephen-Gates Have removed:

Streaming is still on the TODO - perhaps re-open this or add as a new issue. I think it may also be related to potential issues with opening multiple tabs with significant (10 000+) rows. Atm, while we have swapped out jQuery-csv for the same 'fast' csv library that frictionless use, the data is still being 'copied' from array to string and vice versa when moving to and from files. Not sure off the top of my head yet, but if we could find a way to stream this instead of loading everything then this will help. Related to this are: