ITISFoundation / osparc-ops-environments

osparc operations
MIT License
2 stars 6 forks source link

Reduce AWS S3 costs #191

Open mrnicegyu11 opened 1 year ago

mrnicegyu11 commented 1 year ago

Ideas:

mrnicegyu11 commented 1 year ago

Related via https://git.speag.com/oSparc/osparc-ops-environments/-/issues/510:

Data in s3 under api/ is currently disposable

The data uploaded via the public api (i.e. api-server service) is stored under api/* folder in s3.
For the moment (this policy might change in the future) this data is guaranteed for a month and after that it can be deleted (sort of expiration).
Unfortunately this expiration policy is still not implemented therefore you should know that this data is accumulated and can be disposed if you consider so.
mrnicegyu11 commented 3 months ago

Put intelligent tiering everywhere

mrnicegyu11 commented 3 months ago

Talk to the team to keep only files for 30d - talk to POs and team

mrnicegyu11 commented 3 months ago

Intelligent tiering has lead to a cost decrease, but old versions still need to be expired