GeoscienceAustralia / dea-notebooks

Repository for Digital Earth Australia Jupyter Notebooks: tools and workflows for geospatial analysis with Open Data Cube and Xarray
https://docs.dea.ga.gov.au/notebooks/
Apache License 2.0
440 stars 127 forks source link

Error loading bom_rainfall_grids #759

Open Daniel-Trung-Nguyen opened 3 years ago

Daniel-Trung-Nguyen commented 3 years ago

Hi, I got this error when trying to load data from bom_rainfall_grids on the NCI VM. I am a member of the rr5 project RasterioIOError: NETCDF:"/g/data/rr5/agcd/0_05/rainfall/daily/1997/rr.1997010119970101.grid.nc":rain_day: No such file or directory

Here is my code:

central_lon,central_lat = 148.2616,-22.1499 visual_buffer = 0.055 latitude = (central_lat - visual_buffer, central_lat + visual_buffer) longitude = (central_lon - visual_buffer, central_lon + visual_buffer) time = ('1997-01-01','2016-01-01') query = { 'x': longitude, 'y': latitude, 'time': time,

"group_by": 'solar_day', # Add group_by to reduce data

}
ds2 = dc.load(product='bom_rainfall_grids', **query)

robbibt commented 3 years ago

@GypsyBojangles or @omad might have some thoughts on this... I suspect it's been a while since anyone checked this data

Daniel-Trung-Nguyen commented 3 years ago

Thanks for the reply, @robbibt! I am working on a project at QUT monitoring pasture health in relation to climate change. I would love to download the gridded maps of rainfall, temperature, humidity, and solar exposure from the BOM website (http://www.bom.gov.au/climate/maps/) to use in my analysis. Is this something that has been done for the NCI databases? If not, is there an option for me to create a datacube product for these? Thanks, Trung

MatthewJA commented 3 years ago

Are you part of rr5 on the NCI?

Daniel-Trung-Nguyen commented 3 years ago

Hi @MatthewJA, Yes, I am. However, the "agcd" folder did not show up on the g/data/rr5 in my file browser. image image

MatthewJA commented 3 years ago

Yep, that data seems to have been deleted. Anyone know why or where it went?

CEKrause commented 3 years ago

I am not sure, but I got this message from NCI the other day, that may offer an alternative?

Dear NCI Data Users, We are pleased to announce the release of the Australian Gridded Climate Data Collection. The Australian Gridded Climate Data (AGCD) is the Bureau of Meteorology's official dataset for climate analyses covering the variables of rainfall, temperature (maximum and minimum) as well as vapour pressure at daily and monthly timescales. You can register for access through the MyNCI portal. This collection is also available through the NCI THREDDS Data Server. Please see our Data Catalogue for further information on the data products and data access. For any questions, please contact help@nci.org.au.

BexDunn commented 1 year ago

The BoM rainfall grids on the NCI were deleted and replaced with the Australian Gridded Climate Data (AGDC) however the replacement data is monthly and doesn't currently have daily rainfall totals.

Options for replacement in the Estimate climate driver influence on rainfall notebook: include: SILO, ECMWF Re-Analysis 5 (ERA5) , or ANU Climate 2.0 .

Utility may depend on format and model accuracy, with potential stretch goal of introdcuing multiple options here.