[BUDI-7789] Increase services.objectStore.storage default value to 2GB

[likke812]

Checklist

• [X] I have searched budibase discussions and github issues to check if my issue already exists

Hosting

• Self
  • Method: k8s
  • Budibase Version: 2.13.20
  • App Version: 2.10.1

Describe the bug After we upgraded Budibase platform using K8S successfully, we can not update Budibase APP from 2.10.1 to 2.13.10 with popup error as below: Error updating app: [object Object]

And there has HTTP 507 error when checking browser inspector: POST https://***/api/applications/app_dev_***/client/update 507 (Insufficient Storage) [Builder] HTTP 507 on POST:https://***/api/applications/app_dev_***/client/update Storage backend has reached its minimum free drive threshold. Please delete a few objects to proceed.

To Reproduce Steps to reproduce the behavior:

1. Go to 'APP -> Update'
2. Click on 'Update' button and confirm the application update button again
3. See error

Expected behavior Update Budibase application to 2.13.20 successfully

Screenshots Error snapshot:

App Export

Desktop (please complete the following information):

• OS: Windows 10
• Browser: Chrome and Firefox
• Version: 119 and 120

Additional context The df output of all of the three DBs:

Try to update the storage property to 200Mi and then update the deployment, but no effect. Following this post from discussion: https://github.com/Budibase/budibase/discussions/10559

_{From SyncLinear.com | BUDI-7789}

[melohagan]

Hey @likke812

I think this is a MinIO issue. Could you try what was suggested here? https://github.com/Budibase/budibase/issues/8038

Otherwise make sure that you have enough disk space.

[likke812]

Hey @likke812

I think this is a MinIO issue. Could you try what was suggested here? #8038

Otherwise make sure that you have enough disk space.

I have tried to reset my Chrome browser cache or try it with different browser like Firefox or MS Edge. But still I can see the same error.

We have checked with the DB file system storage and it seems there has enough free space?

[melohagan]

Hey @likke812 We have recently updated our helm chart. Could you follow this guide and see if it helps? https://github.com/Budibase/budibase/tree/master/charts/budibase#upgrading

[likke812]

Hey @likke812 We have recently updated our helm chart. Could you follow this guide and see if it helps? https://github.com/Budibase/budibase/tree/master/charts/budibase#upgrading

Hi @melohagan,

We have upgrade our helm chart to 3.0.1 and upgrade Budibase to the latest version - 2.13.31.

But I can still see the same HTTP 507 (Insufficient Storage) error when I tried to update APP from 2.10.1 to 2.13.31.

It seems this helm chart update is not help for my issue :-(

[melohagan]

Hey @likke812 We have recently updated our helm chart. Could you follow this guide and see if it helps? https://github.com/Budibase/budibase/tree/master/charts/budibase#upgrading

Hi @melohagan,

We have upgrade our helm chart to 3.0.1 and upgrade Budibase to the latest version - 2.13.31.

But I can still see the same HTTP 507 (Insufficient Storage) error when I tried to update APP from 2.10.1 to 2.13.31.

It seems this helm chart update is not help for my issue :-(

How many attachments do you have across your apps?

[likke812]

Hey @likke812 We have recently updated our helm chart. Could you follow this guide and see if it helps? https://github.com/Budibase/budibase/tree/master/charts/budibase#upgrading

Hi @melohagan, We have upgrade our helm chart to 3.0.1 and upgrade Budibase to the latest version - 2.13.31. But I can still see the same HTTP 507 (Insufficient Storage) error when I tried to update APP from 2.10.1 to 2.13.31. It seems this helm chart update is not help for my issue :-(

How many attachments do you have across your apps?

I am not clear about "attachments" in your question. I have two APPs in my budibase system with four users accessing to them. I don't have any plugin on my Budibase. In each APP, we have rest api queries and external MySQL database.

[melohagan]

I meant image or file attachments via the attachment column of the internal DB, but that does not appear to be the case for you.

[melohagan]

Have you searched for that error anywhere else - such as follow through this here: https://github.com/minio/minio/issues/16185

[likke812]

Have you searched for that error anywhere else - such as follow through this here: minio/minio#16185

[likke812]

Have you searched for that error anywhere else - such as follow through this here: minio/minio#16185

Thank you @melohagan for your comments! I did searched online to see if there has some tips for this error message for Minio and I got the answer:

https://github.com/minio/minio/issues/6795

From this post, I understand the object persistent storage for Minio shall be at least 1Gb free space which the minimum value is not configurable. So we increase the persistent storage mount volume /data for Minio from 1Gb to 2Gb and now it works fine for the APP updating!

BTW, I guess the upgrading document for Budibase needs to be updated for the "services.objectStore.storage" value, the default 100Mi is not enough(in our case, by default the persistent volume for Minio is 974Mb). It could be set the value to over 1Gb. https://github.com/Budibase/budibase/tree/master/charts/budibase#upgrading

[likke812]

The problem has been resolved by updating Minio persistent volume. You can close it if you want.

Thank you!

[melohagan]

Have you searched for that error anywhere else - such as follow through this here: minio/minio#16185

Thank you @melohagan for your comments! I did searched online to see if there has some tips for this error message for Minio and I got the answer:

minio/minio#6795

From this post, I understand the object persistent storage for Minio shall be at least 1Gb free space which the minimum value is not configurable. So we increase the persistent storage mount volume /data for Minio from 1Gb to 2Gb and now it works fine for the APP updating!

BTW, I guess the upgrading document for Budibase needs to be updated for the "services.objectStore.storage" value, the default 100Mi is not enough(in our case, by default the persistent volume for Minio is 974Mb). It could be set the value to over 1Gb. https://github.com/Budibase/budibase/tree/master/charts/budibase#upgrading

Thanks very much for this suggestion! I'll update the issue title 👍

[samwho]

@likke812 thanks for the suggestion here! I just merged a PR changing that default. Going to close this out now, feel free to get back in touch if you have any other problems! 🙏