pacificclimate / pdp

The PCIC Data Portal - Server software to run the entire web application
GNU General Public License v3.0
1 stars 2 forks source link

Why do many PCDS stations end in 2000? #78

Closed stephenban closed 6 years ago

stephenban commented 6 years ago

I’m currently looking at using some data from the BC Station Data portal, and I noticed that most stations (nearly all FLNRO-WMB) only have timeseries data running up until October-ish 2000. Was there a change in protocol past this point, or did data cease getting collected altogether at these stations?

jameshiebert commented 6 years ago

This dataset is highly heterogeneous, so its hard to generalize without talking about specific stations.

Do you want to shoot us an e-mail if you want to go into more details on this question? The GH issues on this repository are supposed to be for software issues.

stephenban commented 6 years ago

Hi James,

Sorry, the FAQ was a little unclear on where one is supposed to submit questions regarding the data itself.

I was doing a search for stations with daily average relative humidity data from Jan 1st, 1990-December 31st 2017, and it seems that nearly all of the FLNRO-WMB stations stopped collecting data (at least for this particular parameter) on October 1, 2000, if not before.

I do get a lot more stations that extend past the year 2000 if I don’t constrain the collection frequency to daily, but I was curious about the FLNRO-WMB stations and what happened to those stations after October 2000.

But basically in the end all I’m looking for is a climatology of daily humidity values across the province for stations located in or near provincial parks, and hoping there might be a way to extract those data without having to manually select all the stations one by one.

Thanks, Stephen

From: James Hiebert [mailto:notifications@github.com] Sent: Friday, February 23, 2018 10:30 AM To: pacificclimate/pdp Cc: Ban, Stephen ENV:EX; Author Subject: Re: [pacificclimate/pdp] Help wanted (#78)

This dataset is highly heterogeneous, so its hard to generalize without talking about specific stations.

Do you want to shoot us an e-mail if you want to go into more details on this question? The GH issues on this repository are supposed to be for software issues.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/pacificclimate/pdp/issues/78#issuecomment-368097328, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AjET_I9q5EaE95mEdarsfXm_DGIAKcGDks5tXwOngaJpZM4SRMZq.

jameshiebert commented 6 years ago

if I don’t constrain the collection frequency to daily

Ah, you're probably missing out on all of the stations that transitioned from daily measurements to hourly measurements (due to automation).

If you're just looking for climatologies, I would just tick the "Only include stations with 1971-2000 climatology" box and select the "Relative Humidity (Mean)" variable. This turns up 579 stations, across the province.

but I was curious about the FLNRO-WMB stations and what happened to those stations after October 2000

My database query actually turns up very few stations (less than 10 IIRC) that actually end in October 2000. I bet that you're excluding data that they started collecting automatically after that time.