search

eBay / parallec

Fast Parallel Async HTTP/SSH/TCP/UDP/Ping Client Java Library. Aggregate 100,000 APIs & send anywhere in 20 lines of code. Ping/HTTP Calls 8000 servers in 12 seconds. (Akka) www.parallec.io
Apache License 2.0
805 stars 173 forks source link

How to deal with large data flow output based ssh #8

Closed icanfly closed 8 years ago

icanfly commented 9 years ago

If you want to output is completed, may have memory overflow, hoping to provide a way to handle the output stream

jeffpeiyt commented 9 years ago

HI icanfly,

Thanks much for your question and interests in Parallec. By default the response is not saved after the task complete, so there should not a be a problem. Unless your responses on a single task is bigger than the heap size

jeffpeiyt commented 9 years ago

can you try it out and see if it working with your huge output?

icanfly commented 9 years ago

Thanks much for your reply. Okay, I admit that my goal is to return to a steady stream of data, such as the log flow, and perhaps my purpose is not the framework should be done.

jeffpeiyt commented 9 years ago

sure. not a problem. have you considered using log stash etc for this?