euroargodev / argopy

A python library for Argo data beginners and experts
https://argopy.readthedocs.io
European Union Public License 1.2
176 stars 39 forks source link

Cannot fetch the index metadata #236

Closed glouppe closed 1 year ago

glouppe commented 1 year ago

It seems the ArgoFloats-index dataset cannot be fetched anymore. Executing the first code snippet of https://argopy.readthedocs.io/en/latest/visualisation.html#trajectories results in a 404 error.

from argopy import IndexFetcher as ArgoIndexFetcher
idx = ArgoIndexFetcher().float([6902745, 6902746]).load()
ClientResponseError                       Traceback (most recent call last)
File ~/anaconda3/envs/dats0001/lib/python3.10/site-packages/fsspec/implementations/http.py:391, in HTTPFileSystem._info(self, url, **kwargs)
    389 try:
    390     info.update(
--> 391         await _file_info(
    392             url,
    393             size_policy=policy,
    394             session=session,
    395             **self.kwargs,
    396             **kwargs,
    397         )
    398     )
    399     if info.get("size") is not None:

File ~/anaconda3/envs/dats0001/lib/python3.10/site-packages/fsspec/implementations/http.py:772, in _file_info(url, session, size_policy, **kwargs)
    771 async with r:
--> 772     r.raise_for_status()
    774     # TODO:
    775     #  recognise lack of 'Accept-Ranges',
    776     #                 or 'Accept-Ranges': 'none' (not 'bytes')
    777     #  to mean streaming only, no random access => return None

File ~/anaconda3/envs/dats0001/lib/python3.10/site-packages/aiohttp/client_reqrep.py:1005, in ClientResponse.raise_for_status(self)
   1004 self.release()
-> 1005 raise ClientResponseError(
   1006     self.request_info,
   1007     self.history,
   1008     status=self.status,
   1009     message=self.reason,
   1010     headers=self.headers,
   1011 )

ClientResponseError: 404, message='404', url=URL('https://erddap.ifremer.fr/erddap/tabledap/ArgoFloats-index.csv?file,date,longitude,latitude,ocean,profiler_type,institution,date_update&file=~%22(.*)(R%7CD)(6902745%7C6902746)(_.*)%22&distinct()&orderBy(%22date%22)')

Indeed, accessing https://erddap.ifremer.fr/erddap/tabledap/ArgoFloats-index.csv results in a 404 error.

gmaze commented 1 year ago

Hi @glouppe

Web API can show some downtimes This morning your request seems to work fine You can check the status of argopy online ressources at: https://argopy.statuspage.io/ or in your code with:

argopy.status()

more here: https://argopy.readthedocs.io/en/latest/data_sources.html#status-of-sources

and, by the way, I should recommend you to use the gdac data sources for the index fetcher, it's much more efficient than the default erddap.

glouppe commented 1 year ago

Thanks Guillaume! Indeed, everything seems to work now.