MetOffice / aws-earth-examples

Example code of how to freely use Met Office's weather datasets through Earth on AWS.
https://metoffice.gov.uk
Other
42 stars 15 forks source link

Transforming NETCDF file to Relational Databases #10

Closed litethesko closed 4 years ago

litethesko commented 5 years ago

Hi, I am in a process to convert the MET Office Cube Data which is in NETCDF format to relational world for reporting and dashboards. Do you know how can i do that?

jwovens commented 5 years ago

Hi @litethesko . I assume you've seen the getting started page which advocates using the Python iris package to read the data in to memory. There are other tools available at the unidata website such as ncdump that converts the binary into text (arrays of the data) if you find this more convenient.

I should add that if you're wanting to load in to a relational database, you should probably parse the data using Iris and write separate code to put that data in to a data store. I've not found any mature projects (or plugins to database engines) that will load data from native NetCDF as an external table.

armeniopinto commented 5 years ago

Hello @litethesko ! Can you provide us more details about your set-up? What database are you using?