search

Effect-TS / website

Source code for Effect's documentation website
https://www.effect.website
104 stars 84 forks source link

Feedback for “Operations” (docs/400-guides/660-streaming/100-stream/400-operations.mdx) #799

Open florianbepunkt opened 3 months ago

florianbepunkt commented 3 months ago

Hi, what I miss from the stream docs is the "other" side of interoperability. How can I get from an effect Stream back to a "regular" NodeJS stream. We have a lot of scenarios, where we do something like

ReadableStream (API, CSV file, etc) ---> Data Processing ---> Writable Stream (S3 Upload).

Effect is great for the data processing step, but for large data sources, I need to stream the data back (s3 upload in the workflow above), but I have no idea how to get from effect's data stream back to a node stream.

tim-smart commented 3 months ago

There is a module in /platform-node for working with node streams https://effect-ts.github.io/effect/platform-node-shared/NodeStream.ts.html