CADWRDeltaModeling / dms_datastore

Data download and management tools for continuous data for Pandas. See documentation https://cadwrdeltamodeling.github.io/dms_datastore/
https://cadwrdeltamodeling.github.io/dms_datastore/
MIT License
1 stars 0 forks source link

carqb ec formatted data has multiple columns #15

Closed dwr-psandhu closed 7 months ago

dwr-psandhu commented 8 months ago

carqb ec has a different format than all other data sets, i.e. it is multivariate

It is missing value column and has multiple columns with other names. image

should be more like image

dwr-psandhu commented 8 months ago

There is a flag to create sub locations on the fly but that is turned off. The station configs that are checked in look ok but it looks like you are running something from your local that is not committed to the repo.

dwr-psandhu commented 8 months ago

That explains carqb upper/lower ec issue. But doesn't work for fpt ec. I guess it would need to be listed in stations sublocation csv file.

It would be good to have a utility that creates sub locations on the fly and compare to stations sublocations so missing ones can be added after user inspection.

dwr-psandhu commented 8 months ago

Worked around this. It will just use the name of the columns instead of failing. the upper/lower labels can be assigned as seen fit https://github.com/dwr-psandhu/dms_datastore_ui/commit/3216f9d3f93e3261f905f172f8cbb3fc7207b6d5

dwr-psandhu commented 7 months ago

For EC the following stations have this issue c24, m13, dum, mateo, richb

For temp the following stations have this issue benbr, c24, carqb, dum, fpt, m13, mateo, richb