Filter script for time series

HDFGroup / datacontainer

Data Container Study

Other

8 stars 1 forks source link

Filter script for time series #3

Closed jreadey closed 8 years ago

jreadey commented 9 years ago

Create a filter script that extracts a given time series from the NCEP data collection.

jreadey commented 8 years ago

I created a simple filter here: filters/series.py. @ajelenak-thg - can you adopt this to use actual lat/lon? Also, would it be useful to support doing an extraction for a lat/lon bounding box?

jreadey commented 8 years ago

I've created a convertor script for ghcn files: https://github.com/HDFGroup/datacontainer/commit/a8e98435ac1f631b1a0f1ee0ab7e75a2276903dd.

It takes some time to run though (~3 hours for a 900MB csv file). Will update to do conversion in parallel.

jreadey commented 8 years ago

Added benchmark scripts for query of timeseries (ghcn).