search

hoodiehq-archive / hoodie-plugins-manager

:no_entry: part of hoodie-server now
http://github.com/hoodiehq/hoodie-server
Apache License 2.0
3 stars 5 forks source link

Load Balancing for Workers #3

Open janl opened 11 years ago

janl commented 11 years ago

Currently all plugins run within the same node process as hoodie-server. In the future it should be possible to run plugins in separate node processes that run on the same or even different machines.

The plugin code should not have to change for that. hoodie-pllugins-manager should just distribute jobs over available workers. In addition, maybe we want to have auto-launching of new workers if loads increases.

For now this can all be done using the hoodie.task API and implementation, but once this reaches a high-traffic situation for a single app, we might have to look into proper queues to implement hoodie.task behind the scenes.

caolan commented 10 years ago

We might want to avoid spawning processes for each worker in some cases to avoid the overhead on small installs. Something to discuss anyway.