search

zalando / postgres-operator

Postgres operator creates and manages PostgreSQL clusters running in Kubernetes
https://postgres-operator.readthedocs.io/
MIT License
4.11k stars 949 forks source link

High List API Requests in a S3 Bucket #2631

Open tarunmittal24 opened 1 month ago

tarunmittal24 commented 1 month ago

I have enabled the postgres-backup to the s3 bucket and with the frequency of the cronjob to run on every minute, which is obviously not a best way to implement this, But after this i faced some issues and that incur a huge cost as well.

  1. My DB Size is 110 mb, but my pvc is around 30GB, which is also got completely filled up, complete 100% usage of that pvc, not sure why that happened??, but after checking got to know that , continuous backup will filled up the pg_wal directory files , not sure it is true or not ??

  2. My S3 API requests are also got increased too much, see the screenshot below., not sure why that is got happened, as size in my s3 bucket will increase that is totally acceptable, but why list api operation is more rather than the put operations which is the actual thing needs to get increased when continuously backup is running.

Screenshot 2024-05-19 at 16 37 11 Screenshot 2024-05-19 at 16 37 34
tarunmittal24 commented 1 month ago

@FxKu , can you please help me on this.