hotosm / oam-server

DEPRECATED: OpenAerialMap processing and tile server
4 stars 3 forks source link

Implement load balancing mechanism #7

Open cgiovando opened 9 years ago

cgiovando commented 9 years ago

This is particularly important if implementing a more dynamic solution, where processing resources need to scale to support demand efficiently. Something that can be done with Elastic Load Balancing for the AWS-hosted OAM, and possibly with multithread strategy when done on a local computer.

mojodna commented 9 years ago

ELB and HAProxy are straightforward ways to implement this (recommended for both hybrid and dynamic).

Implementing appropriate auto-scaling rules (or finding ways to use Lambda either for all traffic or as a supplement) is going to be the primary challenge here:

hectcastro commented 9 years ago

The API servers will have processes to publish CloudWatch metrics on SWF decider and activity worker task list counts. The plan is to reuse those for scaling the ASGs for deciders and activity workers.

See also: https://github.com/hotosm/oam-server-deployment/pull/1