andywer / ideabox

Place to collect techy ideas and get feedback.
1 stars 1 forks source link

Beyond threads.js: Node.js cloud workers #25

Open andywer opened 4 years ago

andywer commented 4 years ago

A distributed cluster of worker nodes, either hosted by the user or by an IaaS offering. Dispatch jobs to it as if it was a local threads.js worker pool.

Cluster is identified by a discovery endpoint URL. The discovery endpoint is either provided by the user or by the aforementioned IaaS provider. Workers use some kind of secret key / token to authenticate and join cluster.

Cluster users (usually backend services) can use the discovery endpoint to find worker nodes and authenticate using cluster credentials to manage jobs or query stats.

A cluster dashboard would of course be great.

Benefits

TBD