Load function for weather stations

JuliaClimate / ClimateTools.jl

Climate science package for Julia

https://juliaclimate.github.io/ClimateTools.jl/stable/

Other

117 stars 16 forks source link

Load function for weather stations #39

Open Balinus opened 6 years ago

Balinus commented 6 years ago

We need a function that will load weather stations data.

The problem is that there is no standard for such data.

Objectives

Canadian weather stations
NCEI weather stations (see NCEI package)
A hardcoded way to import csv data (columns is station, rows are time)

Zeitsperre commented 6 years ago

I've done a fair amount of this (badly) in python. There might be a way to adapt some of my work in https://github.com/Zeitsperre/canada-climate-python to perform this.

While this work didn't use pandas, I'm wondering if an implementation of it or something similar to it exists for Julia. Environement Canada station data is less-than-optimally formatted, so a portion of my code simply deals with workarounds that pandas might be better suited for. I'll start looking into this Monday.

Balinus commented 6 years ago

DataFrames.jl and Pandas.jl could be a solution, but would add other dependencies. The other option would be to continue with AxisArrays.jl which can index Categorical axis (station number for example).

Balinus commented 5 years ago

@houton199 Any code that could be used here?

Zeitsperre commented 5 years ago

@Balinus

I've retackled this issue in a few places, converting either ECCC flat files or CSVs to NetCDF with "loose" CF conventions. The code is the work of several people (@sbiner, @RondeauG) and is currently being integrated into Ouranosinc/miranda. See https://github.com/Ouranosinc/miranda/tree/master/miranda/eccc for some examples of how we're dealing with hourly flat files. Feel free to take inspiration or raise issues or suggest edits if you see something.

Balinus commented 5 years ago

Thanks! Will have a look.