pangeo-data / pangeo-eosc

Pangeo for the European Open Science cloud
https://pangeo-data.github.io/pangeo-eosc/
MIT License
3 stars 3 forks source link

quota problem on min-io? #77

Open tinaok opened 1 month ago

tinaok commented 1 month ago

76

I can create 50MiB of zarr file but I can't if it is 70MiB. This is the notebook which shows the problem. https://github.com/pangeo-data/pangeo-eosc/blob/tinaok-patch-1/users/how-to/quota_pb_minio.ipynb I would like to have a space todaka-histogen, where I can write file, and other people can use my data.
How can I increase the quota? How can I set bucket for doing this?

Thank you for your help.

sebastian-luna-valero commented 1 month ago

Hi,

Re-running the notebook wrote the test.zarr into JupyterHub rather than MinIO. I am not sure how to update the code to properly write into MinIO.

On the other hand, I have also used this other example to test MinIO. Could you please give it a try and let me know how it goes?

tinaok commented 1 month ago

Thank you @sebastian-luna-valero

The other example works if I keep the file size small.
It cannot handle large files. It works for me with files up to 50 MiB. Could you please try re-running the notebook with the following change?

size_in_MiB = 50

Change 50 to, for example, 500.

As seen in this image, I cannot change or know the quota of my space.

スクリーンショット 2024-05-16 22 55 24

Do you know:

How to find out the quota for each bucket?
How to change the quota for each user's space?
sebastian-luna-valero commented 1 month ago

Hi Tina,

Before troubleshooting further, these cells in your notebook:

image

Create a local folder in JupyterHub instead of MinIO:

image

Do you get the same?

tinaok commented 1 month ago

Yes I get the same thing.

Sometime I can write sometime I can't. And I can't change the quota.

sebastian-luna-valero commented 1 month ago

Hi Tina,

This is the problem, then. Your code is not writing to MinIO, and that's why you get the issue.

Could you please double check why your code is not writing to MinIO? In case it helps, this other example does write to MinIO.