AWS: decrease cost for ~Summer~ Autumn 2023

dduportal commented 1 year ago

Follow up of https://github.com/jenkins-infra/helpdesk/issues/3502

Top level goal is to decrease the AWS bill to $5,000 per month.

The June 2023 costs broken down by usage type:

The following tasks are required:

Move the updates.jenkins.io (pkg.origin.jenkins.io) VM out from AWS: https://github.com/jenkins-infra/helpdesk/issues/2649
- It is the reason of the "Data transfer Out" cost usage
- It is an Ubuntu 18.04 machine (ref. #2982 )
- It is not highly available
Move the usage.jenkins.io VM to Azure: https://github.com/jenkins-infra/helpdesk/issues/1626
Move the census.jenkins.io VM to Azure (issue to be done)
Add a Garbage collector for the S3 artefacts from ci.jenkins.io (ref. https://github.com/jenkins-infra/helpdesk/issues/3663)

### Tasks
- [ ] https://github.com/jenkins-infra/helpdesk/issues/2649
- [ ] https://github.com/jenkins-infra/helpdesk/issues/1626
- [x] https://github.com/jenkins-infra/helpdesk/issues/3663
- [x] https://github.com/jenkins-infra/helpdesk/issues/3954

dduportal commented 10 months ago

Update: title updated to move Summer to Autumn...

dduportal commented 9 months ago

Update: Removed a bunch of S3 buckets in https://github.com/jenkins-infra/helpdesk/issues/3762

dduportal commented 9 months ago

Update:

More dangling resources cleanup in https://github.com/jenkins-infra/aws/pull/473

TODO:

Need to remove the following IAM users (and eventually associated resources):
- jenkins-infra-ci (https://github.com/jenkins-infra/aws/pull/473/files#diff-09ee06ee2289b6361e23b5c23d9b90725e635e5684537cc6648819ac44c6f1e0L2-L4)
- jenkins-ci (https://github.com/jenkins-infra/aws/pull/473/files#diff-09ee06ee2289b6361e23b5c23d9b90725e635e5684537cc6648819ac44c6f1e0L57-L59)
- ci-packer (never tracked as code)
- helpdesk-3762 (leftover of https://github.com/jenkins-infra/helpdesk/issues/3762)

dduportal commented 9 months ago

Update:

TODO:

* Need to remove the following IAM users (and eventually associated resources):

  * `jenkins-infra-ci` (https://github.com/jenkins-infra/aws/pull/473/files#diff-09ee06ee2289b6361e23b5c23d9b90725e635e5684537cc6648819ac44c6f1e0L2-L4)
  * `jenkins-ci` (https://github.com/jenkins-infra/aws/pull/473/files#diff-09ee06ee2289b6361e23b5c23d9b90725e635e5684537cc6648819ac44c6f1e0L57-L59)
  * `ci-packer` (never tracked as code)
  * `helpdesk-3762` (leftover of [Migrate Terraform states from AWS S3 to Azure buckets  #3762](https://github.com/jenkins-infra/helpdesk/issues/3762))

Done!

dduportal commented 2 months ago

Update on this topic:

https://github.com/jenkins-infra/helpdesk/issues/3954 has been added and done: all us-east-2 resources have been removed and are migrated somewhere else than CloudBees AWS account.
As such, https://github.com/jenkins-infra/helpdesk/issues/3663 is obsolete and closed

(HARD) Work is in progress in https://github.com/jenkins-infra/helpdesk/issues/2649

jenkins-infra / helpdesk

AWS: decrease cost for ~Summer~ Autumn 2023 #3662