GenericMappingTools / gmtserver-admin

Cache data and script for managing the GMT data server
GNU Lesser General Public License v3.0
7 stars 3 forks source link

Update to WDMAM v2.1 in Main server. #208

Closed Esteban82 closed 1 year ago

Esteban82 commented 1 year ago

I will update the data of WDMAM 2.1 on the main server.

The steps to follow are:

  1. [x] Test the files already in the test server. I think that they are ok. @seisman, do you agree?
  2. [x] Make a PR with the new gmt_data_server.txt and the earth_wdmam_server.txt (with the info of WDMAM 2.1) in this repo.
  3. [x] Copy and place the updated gmt_data_server.txt file and WDMAM from the test server to the main server.
  4. [x] Merge the PR.
  5. [x] Revise and merge the new info in the remote sets (#58 in remote data sets).
  6. [x] Close this issue.
seisman commented 1 year ago
  • Test the files already in the test server. I think that they are ok. @seisman, do you agree?

I have no knowledge about this dataset. I just plotted the 05m and 06m datasets in the main and test servers. They look the same. So they should be OK.

Esteban82 commented 1 year ago

I will leave this open to see if there is any issue.

I run this and it seems that it is ok.

gmt set GMT_DATA_SERVER Oceania
gmt grdcut @earth_wdmam_30m_g -Rd -Gout.nc
gmt grdinfo out.nc

grdcut [NOTICE]: Remote data courtesy of GMT data server Oceania [http://oceania.generic-mapping-tools.org]
grdcut [NOTICE]: WDMAM Earth Magnetic Anomalies v2.1 at 30x30 arc minutes reduced by Gaussian Cartesian filtering (55.6 km fullwidth) [Choi et al. 2023].
grdcut [NOTICE]:   -> Download grid file [381K]: earth_wdmam_30m_g.grd
out.nc: Title: Produced by grdcut
out.nc: Command: gmt grdcut @earth_wdmam_30m_g -Rd -Gout.nc
out.nc: Remark: Reduced by Gaussian Cartesian filtering (55.6 km fullwidth) from grid.nc [Choi et al. 2023; https://doi.org/10.1186/s40623-016-0404-6]
out.nc: Gridline node registration used [Geographic grid]
out.nc: Grid file format: nf = GMT netCDF format (32-bit float), CF-1.7
out.nc: x_min: -180 x_max: 180 x_inc: 0.5 (30 min) name: longitude n_columns: 721
out.nc: y_min: -90 y_max: 90 y_inc: 0.5 (30 min) name: latitude n_rows: 361
out.nc: v_min: -1447.20019531 v_max: 5110.20019531 name: anomaly (nT)
out.nc: scale_factor: 1 add_offset: 0
out.nc: format: netCDF-4 chunk_size: 145,181 shuffle: on deflation_level: 3
out.nc: Default CPT: @earth_wdmam.cpt
PaulWessel commented 1 year ago

Get the same here so seems fine.

Esteban82 commented 1 year ago

Here I couldn't get the files from the Chinese server. @seisman? The Australian Server works. So, I think it is samething else.

Chinese Server:

bash wdmam_2.1.sh http://china.generic-mapping-tools.org grdcut [NOTICE]: Remote data courtesy of GMT data server China [http://china.generic-mapping-tools.org] grdcut [NOTICE]: WDMAM Earth Magnetic Anomalies v2.1 at 6x6 arc minutes reduced by Gaussian Cartesian filtering (11.2 km fullwidth) [Choi et al. 2023]. grdcut [NOTICE]: -> Download grid file [8.0M]: earth_wdmam_06m_g.grd grdcut [ERROR]: Libcurl Error: HTTP response code said error grdcut [ERROR]: Probably means @earth_wdmam_06m_g.grd does not exist on the remote server grdcut [ERROR]: Unable to obtain remote file @earth_wdmam_06m_g.grd grdinfo [ERROR]: Cannot find file out.nc grdinfo [ERROR]: Must specify one or more input files rm: cannot remove 'out.nc': No such file or directory

Australian Server:

federico@loki:~/Github/Esteban82/Pruebas_Privadas/Datos Servidor$ bash wdmam_2.1.sh http://australia.generic-mapping-tools.org grdcut [NOTICE]: Remote data courtesy of GMT data server Australia [http://australia.generic-mapping-tools.org]

grdcut [NOTICE]: WDMAM Earth Magnetic Anomalies v2.1 at 6x6 arc minutes reduced by Gaussian Cartesian filtering (11.2 km fullwidth) [Choi et al. 2023]. grdcut [NOTICE]: -> Download grid file [8.0M]: earth_wdmam_06m_g.grd out.nc 10 13 -60 -58 -780.400146484 517.199951172 0.1 0.1 31 21 0 1

Full script. I run it twice. Between each time I deleted my local file (in /.gmt/server/earth/earth_wdmam/).

#gmt set GMT_DATA_SERVER China. 
gmt set GMT_DATA_SERVER Australia
gmt --show-dataserver
data=@earth_wdmam_06m_g
gmt grdcut ${data} -R10/13/-60/-58 -Gout.nc # --GMT_DATA_SERVER=test
gmt grdinfo out.nc -C
seisman commented 1 year ago

The settings of the Chinese server is slightly different from all other servers and it requires the curl user agent to be set when download files, but GMT 6.4 doesn't set curl user agent so it fais. PR https://github.com/GenericMappingTools/gmt/pull/7724 fixed the issue recently.

Esteban82 commented 1 year ago

Ok, thanks.