search

ipeterov / convenient-rpc

Convenient APIs for calling python functions remotely at many workers.
MIT License
0 stars 0 forks source link

Rework HTTP API to reduce request count #16

Closed ipeterov closed 8 years ago

ipeterov commented 8 years ago

Making server accept many answers at once and giving many answers aat once is a solution. It doesn't matter if the request count between workers and server is big - the latency between them is negligible.

The other question is whether big answer requests should block until all the answers are ready, or if it's possible to somehow "stream" the answers in one connection. This might be a huge issue.

ipeterov commented 8 years ago

It's very important to find out how to use some kind of streaming in requests because map and map_unordered don't behave as they should - they wait for all the tasks to be completed.