search

cloudfoundry / bosh

Cloud Foundry BOSH is an open source tool chain for release engineering, deployment and lifecycle management of large scale distributed services.
https://bosh.io
Apache License 2.0
2.03k stars 658 forks source link

[feature] Auto-scaling of instances #1652

Closed dmlemos closed 3 years ago

dmlemos commented 7 years ago

Auto-scaling of bosh deployed instances in AWS or Azure.

Scaling up

Based on resource load. Our use case is to scale concourse workers based on load. We come across this often.

Benefits: High-availability, Reliability

Scale down

Based on low activity periods (dynamic or on-schedule) Dynamic: If instances stay idle for a long period On-schedule: during weekends or at night.

Benefits: Saving costs

Suggestion

Use whatever the cloud provider offers: auto-scaling groups in AWS, availability sets in Azure and the equivalent for others.

cppforlife commented 7 years ago

@vito btw is there functionality in concourse to keep on retrying work until at least one worker is available?

dmlemos commented 7 years ago

In fact today we hit DB limits. Although state servers it is a totally different story, there is plenty of use cases out there :)

dmlemos commented 7 years ago

I have updated the comments with benefits and suggest to use the cloud provider offer.

vito commented 7 years ago

@cppforlife Not at the moment, no.

smahesh3 commented 6 years ago

Any update on this? Any plans to include this feature in your roadmap?

anoop2811 commented 5 years ago

Would be great feature to add to scale out deployments and keep the operators happy. Any updates or plans of doing this feature?

gavinbunney commented 5 years ago

This would be a huge help with CI systems as well, so we could scale out Concourse as needed for larger automation suites and scale it back down automatically.

For operating K8S, being able to use the ClusterAutoscaler would be great as well: https://github.com/kubernetes/autoscaler/blob/master/cluster-autoscaler/cloudprovider/aws/README.md

Perhaps BOSH could manage/use an AutoscalingGroup (in AWS' case) rather than individual instances?

bloeys commented 3 years ago

We are also interested in this for automatically scaling our CF deployment. Something similar to the app autoscaler would be amazing for deployments.

Any news so far? If not, maybe pointers to what bosh APIs might be useful to build such a thing?

bosh-admin-bot commented 3 years ago

This issue was marked as Stale because it has been open for 21 days without any activity. If no activity takes place in the coming 7 days it will automatically be close. To prevent this from happening remove the Stale label or comment below.

bosh-admin-bot commented 3 years ago

This issue was closed because it has been labeled Stale for 7 days without subsequent activity. Feel free to re-open this issue at any time by commenting below.