m2lines / pyqg_parameterization_benchmarks

Public-facing git repository for JAMES submission, "Benchmarking of machine learning ocean parameterizations in an idealized model"
MIT License
10 stars 3 forks source link

Unable to retrieve single dataset file on Globus #8

Open pbluc opened 1 year ago

pbluc commented 1 year ago

Early on last week, I ran into an issue with accessing the datasets hosted on Globus. It appears just one dataset no longer exists anymore which is jet/forcing3.zarr. When I attempt to retrieve it I get the following error message:

FileNotFoundError: https://g-402b74.00888.8540.data.globus.org/jet/forcing3.zarr/.zmetadata

Upon following the hyperlink in the above error message, I was met with the following:

GlobusError: v=1 c=INTERNAL_ERROR
GridFTP-Error: globus_xio_register_open
globus_xio: Unable to open file /jet/forcing3.zarr/.zmetadata
globus_xio: System error in open: No such file or directory
globus_xio: A system call failed: No such file or directory

I've been able to retrieve all other datasets just fine except this one. This isn't blocking my work or in need to be fixed urgently, or at all, but I just wanted to make it known that this was occurring.

menggedu commented 1 year ago

Early on last week, I ran into an issue with accessing the datasets hosted on Globus. It appears just one dataset no longer exists anymore which is jet/forcing3.zarr. When I attempt to retrieve it I get the following error message:

FileNotFoundError: https://g-402b74.00888.8540.data.globus.org/jet/forcing3.zarr/.zmetadata

Upon following the hyperlink in the above error message, I was met with the following:

GlobusError: v=1 c=INTERNAL_ERROR
GridFTP-Error: globus_xio_register_open
globus_xio: Unable to open file /jet/forcing3.zarr/.zmetadata
globus_xio: System error in open: No such file or directory
globus_xio: A system call failed: No such file or directory

I've been able to retrieve all other datasets just fine except this one. This isn't blocking my work or in need to be fixed urgently, or at all, but I just wanted to make it known that this was occurring.

Hi, currently. I ran into this problem for every dataset. I'm wondering if all the datasets are not available right now. File "/opt/conda/lib/python3.8/site-packages/fsspec/implementations/http.py", line 213, in _raise_not_found_for_status raise FileNotFoundError(url) FileNotFoundError: https://g-402b74.00888.8540.data.globus.org/jet/low_res.zarr/.zmetadata