search

dmanjunath / node-redshift

A simple collection of tools to help you get started with Amazon Redshift from node.js
69 stars 48 forks source link

What about streaming? #3

Open cabrinoob opened 8 years ago

cabrinoob commented 8 years ago

Is there a way to stream out rows from redshift instead of getting the entire dataset into memory before return it to client?

Thank you for your help

dmanjunath commented 8 years ago

Yeah! Theoretically there's a way to do this using redshift cursors and node streams like in this module https://github.com/brianc/node-pg-query-stream. A streaming API is a great feature idea but this project currently doesn't have support for it. But I'm going to put it on the feature list for the next version.

On May 3, 2016, at 2:22 AM, cabrinoob notifications@github.com wrote:

Is there a way to stream out rows from redshift instead of getting the entire dataset into memory before return it to client?

Thank you for your help

— You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub

raffacabofrio commented 5 years ago

This would be nice.

I need to write a very large csv. And would be nice to append row by row.