AustralianAntarcticDivision / raadtools

Tools for Synoptic Environmental Spatial Data
http://australianantarcticdivision.github.io/raadtools/
24 stars 3 forks source link

directory changes #67

Closed mdsumner closed 6 years ago

mdsumner commented 6 years ago

notes from the bb-frontline:

  1. cryosat2 was previously in something.leeds.ac.uk, now in earth.esa.int (and simplified format, just one nc file).
  2. the IBCSO background raster (not the data, just the image) is moving from www.ibcso.org to hs.pangaea.de (alongside the actual IBCSO data).
  3. OIv2 SST daily moving from eclipse.ncdc.noaa.gov, to www.ncei.noaa.gov AND WITH DIFFERENT DIRECTORY STRUCTURE. The eclipse.ncdc directory does not contain any data after end 2017.
raymondben commented 6 years ago

Does raadtools recognize the data_deprecated directory? If I move the www.ibcso.org and ecipse.ncdc.noaa.gov directories from data/ to data_deprecated/, will that break raadtools?

mdsumner commented 6 years ago

Actually I think the file scan is robust to that, it will find the old files if not the new so that buys time. Not every client sees PRIVATE but most do still

mdsumner commented 6 years ago

Re Cryosat2 I also see this, which seems not ideal :) - I think my filter logic would not actively prevent finding this.

earth.esa.int/documents/10174/3082676/__MACOSX/._Antarctica_DEM_CryoSat2_v1.2.nc

The logic to avoid that better in blueant than raad*, but probably worth an email to them?

mdsumner commented 6 years ago

Updates to raadfiles to support these changes https://github.com/AustralianAntarcticDivision/raadfiles/commit/fce3b170717d4a2e312f3d5bf6fb8bad003c71d6

And in raadtools: https://github.com/AustralianAntarcticDivision/raadtools/commits/master