Upload qc back to Hakai database

[JessyBarrette]

I started a little notebook to run the conversion between your data packages qc to send back to the database:

https://colab.research.google.com/drive/15VeHU-oV_DUZLY2Dbe8dB0v3FFIg1lUQ?usp=sharing

Steps:

• [ ] Read qced csv from data package
• [ ] timezone = UTC-7:00
• [ ] map variables to original variables
• [ ] Convert data to the original format
• [ ] Convert timestamp to expected time
• [ ] Test upload to db

[JessyBarrette]

@emilyhaughton the value presented in your data package does it corresponds to the mean value within the original data?

[emilyhaughton]

@JessyBarrette;

--yes, it corresponds to the mean value within the original data --timezone = PST --the shift in data is usually not common practice, but mostly happens when a standalone water level sensor has been re-deployed at a different elevation, so a correction needs to be applied to the time-series so it reflects a consistent depth -- it also happens with the realtime PLS water level sensors on Calvert when a sensor fails and another one is installed but in a slightly different depth/location

I don't know that the tool needs to support this function, but it will come up from time to time so having a way to handle it would be good...Could be sussed out by having a rate of change check that auto flags as SVC...Then I could pull out those values, adjust them, and resubmit?

[JessyBarrette]

yeah I need to think of something, I could see a way to fix them during the standalone data submissions but for the realtime that wouldn't work. Adding a feature in the qc tool for that could be doable but I don't think this is the purpose of the qc tool.

I'll think about it.

[JessyBarrette]

For the timezone PST. You mean a constant UTC−07:00 or this is local time which includes the daylight savings.

[emilyhaughton]

Constant UTC-07:00

On Fri, Jan 26, 2024 at 8:17 AM Jessy Barrette @.***> wrote:

For the timezone PST. You mean a constant UTC−07:00 or this is local time which includes the daylight savings.

— Reply to this email directly, view it on GitHub https://github.com/emilyhaughton/koeye-stream-timeseries/issues/1#issuecomment-1912233670, or unsubscribe https://github.com/notifications/unsubscribe-auth/AONQKUAEUO22LPHZLXOT4ELYQPCHFAVCNFSM6AAAAABCLDGWFCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMJSGIZTGNRXGA . You are receiving this because you were mentioned.Message ID: @.***>

[JessyBarrette]

Great that saves some headaches!!