Closed eXigentCoder closed 3 weeks ago
This is somehow expected, what exactly do you want to stream from the workers?
stdout/err
?
So essentially, each worker is going to receive a noql query which is similar to SQL, it will then parse and execute it against a MongoDB server and then for each chunk, run some transforms that are CPU intensive and stream the results back, allowing us to scale horizontally.
I guess for the example, I was expecting some console output showing how it was using the streams.
For that, you can use this example to see how an stream
can be used.
If you set each chunk as a single string that can be printed into console without parsing, you don't need to pipe it to process.stdout
but rather just use console.log
on every chunk.
Thanks so much, will take a look!
Hey there, #137 might be related, I copied the files from
~/examples/stream
, created a basicpackage.json
file withpiscina
as the only dependency did annpm install
and then tried to run it and I get the following warning with no other output to the console:I tried
useAtomics: false
as well but get the same error.Still trying to get to grips with the library so might be a misunderstanding on my part but essentially want I want to do is stream results out of the worker, so this might not even be the right example for my use case 😂
Tried it with both node
v16.18.1
andv20.14.0