Get a chunk "on-demand"

mholt / PapaParse

Fast and powerful CSV (delimited text) parser that gracefully handles large files and malformed input

http://PapaParse.com

MIT License

12.54k stars 1.15k forks source link

Get a chunk "on-demand" #354

Open DataGrump opened 8 years ago

DataGrump commented 8 years ago

As far as I understand it, If configured for using a worker and a stream, PapaParse reads a CSV and returns the chunk in a callback as soon as it is ready. However, this methodology does not allow me to use a producer/consumer paradigm (I'm looking to upload each chunk as a separate file to a cloud-based filesystem).

It would be great if the parsing could just wait with processing the next chunk until a method like getNextChunk(callback) is called.

pokoli commented 7 years ago

If anyone is interested on this feel free to create a Pull Request for it.