jameshiebert
commented
9 years ago Hi Patrick,
Downloading the full domain for one of the climate rasters is fairly straight forward.
First of all, to get the URLs for your datasets of interest (A2 and B1 scenarios), just make a request to our data catolog: http://tools.pacificclimate.org/dataportal/hydro_model_out/catalog/
With its response, it's easy to filter and select the data sets you want:
hiebert@aether:~$ curl http://tools.pacificclimate.org/dataportal/hydro_model_out/catalog/ | grep "\(A2\|B1\)"
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 3904 100 3904 0 0 11369 0 --:--:-- --:--:-- --:--:-- 11381
"5var_day_HadCM_B1_run1_19500101-20981231": "http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_HadCM_B1_run1_19500101-20981231.nc",
"5var_day_GFDL2.1_B1_run1_19500101-20991231": "http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_GFDL2.1_B1_run1_19500101-20991231.nc",
"5var_day_CGCM3_A2_run1_19500101-20991231": "http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_CGCM3_A2_run1_19500101-20991231.nc",
"5var_day_ECHAM5_B1_run1_19500101-20981231": "http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_ECHAM5_B1_run1_19500101-20981231.nc",
"5var_day_MIROC3.2_B1_run1_19500101-20991231": "http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_MIROC3.2_B1_run1_19500101-20991231.nc",
"5var_day_HadCM_A2_run1_19500101-20991231": "http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_HadCM_A2_run1_19500101-20991231.nc",
"5var_day_CSIRO35_A2_run1_19500101-20981231": "http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_CSIRO35_A2_run1_19500101-20981231.nc",
"5var_day_CCSM3_B1_run1_19500101-20991231": "http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_CCSM3_B1_run1_19500101-20991231.nc",
"5var_day_HadGEM1_A2_run1_19500101-20981231": "http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_HadGEM1_A2_run1_19500101-20981231.nc",
"5var_day_CGCM3_B1_run1_19500101-20991231": "http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_CGCM3_B1_run1_19500101-20991231.nc",
"5var_day_CSIRO35_B1_run1_19500101-20981231": "http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_CSIRO35_B1_run1_19500101-20981231.nc",
"5var_day_GFDL2.1_A2_run1_19500101-20991231": "http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_GFDL2.1_A2_run1_19500101-20991231.nc",
"5var_day_MIROC3.2_A2_run1_19500101-20981231": "http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_MIROC3.2_A2_run1_19500101-20981231.nc",
"5var_day_ECHAM5_A2_run1_19500101-20991231": "http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_ECHAM5_A2_run1_19500101-20991231.nc",
"5var_day_CCSM3_A2_run1_19500101-20991231": "http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_CCSM3_A2_run1_19500101-20991231.nc"The response is JSON, so you can process it in most any programming lanugage as well.
With each of those URLs, it's easy to request the full domain. If you want all of the hydrologic variables, you can just request those URLs directly. If you really only want SWE, just add .nc?swe to each base URL. For example: http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_CCSM3_A2_run1_19500101-20991231.nc.nc?swe
If at some point in the future, you do want some custom hyperslab of the data, you can request the raster shape of each dataset by adding .dds to the catalog URL.
hiebert@aether:~$ curl http://tools.pacificclimate.org/dataportal/hydro_model_out/catalog/5var_day_CCSM3_A1B_run1_19500101-20991231.nc.dds?swe
Dataset {
Grid {
Array:
Float32 swe[time = 54787][lat = 163][lon = 215];
Maps:
Int32 time[time = 54787];
Float64 lat[lat = 163];
Float64 lon[lon = 215];
} swe;
} 5var_day_CCSM3_A1B_run1_19500101-20991231%2Enc;This shows you the number of time steps, and number of grid cell on both axes. Then if you just want a subdomain, you would request something like this: http://tools.pacificclimate.org/dataportal/hydro_model_out/data/5var_day_CCSM3_A2_run1_19500101-20991231.nc.nc?swe[0:100][0:160][0:200]
That would give you the first 101 time steps, and a 161x201 spatial domain.
Hope that helps.
hydropatch
basilveerman
AreliaTW
Hello,
I am having trouble downloading data from the PCIC data portal "Gridded Hydrologic Model Data". Specifically, I need to download the entire dataset for one variable (SWE) for each of 8 model runs, for each of A2 and B1 scenarios, for 1950-2100, across the entire area (ie. Fraser, Peace, Upper Columbia, and Campbell River). Unfortunately, I have run into some problems using the PCIC data portal - specifically, when I try to select the entire modelled dataset (i.e. a single dataset for each model/scenario for the entire geographic area) I receive an error message and am forced to zoom in and download a smaller geographical area.
Would you be able to make this data available for the entire geographical extent (or for the Peace, Upper Columbia, Fraser and Campbell basins individually) or is there a way to use the Data Portal to get what I need?