It looks like searoute processes all input CSV lines before writing any result rows out to disk. When the input CSV file has many lines, this buffering can lead to an out of memory error.
Any chance this behavior could be changed so that each result is written (streamed) to disk as soon as it is computed? This would avoid the need for all results to be buffered in memory.
Hello!
Thank you for searoute!
It looks like searoute processes all input CSV lines before writing any result rows out to disk. When the input CSV file has many lines, this buffering can lead to an out of memory error.
Any chance this behavior could be changed so that each result is written (streamed) to disk as soon as it is computed? This would avoid the need for all results to be buffered in memory.
Thank you for your consideration.
Sincerely, Ben