search

SlideRuleEarth / sliderule

Server and client framework for on-demand science data processing in the cloud
https://slideruleearth.io
Other
26 stars 11 forks source link

Modify load balancer and proxy code to favor smaller requests on public cluster #365

Open jpswinski opened 6 months ago

jpswinski commented 6 months ago

Include logic in either (or both) the orchestrator.lua and the EndpointProxy to favor processing smaller requests when running on a public cluster.

Periodically, the public cluster gets used by a group doing a large run - this run consumes all of the resources of the public cluster and prevents other people from having timely responses in their smaller requests.