WSWCWaterDataExchange / MappingStatesDataToWaDE2.0

Manage all code to map and import state's data into WaDE 2.0
BSD 3-Clause "New" or "Revised" License
4 stars 1 forks source link

New Oklahoma (OK) site-specific RO time series data #182

Closed amabdallah closed 7 months ago

amabdallah commented 1 year ago

New portal for Oklahoma using Aquarius (similar to Wyoming) https://data-owrb.aquaticinformatics.net/Content/Manuals/en/UserGuide.pdf

Portal https://data-owrb.aquaticinformatics.net/Data

rwjam commented 1 year ago

We are primarily after Discharge timeseries info. And maybe stage height timeseries info (really whatever we can get...)

Having trouble downloading all the site info / wanted time series info. Having to do one file at a time, which is turning into too much stitching.

According to the user guide, there should be a way to bulk download multiple files / datasets, but this feature ‘might’ be hidden behind login credentials (see image).

image

rwjam commented 1 year ago

To meet our upcoming deliverable, let's just grab what we can for now.

The download timeseries doesn't provide a identifier to stich too, we 'might' be able to use the api link to manually add this in via an api all.

image

amabdallah commented 1 year ago

FYI Justin emailed me saying they added the "download button" now on the left side bar. I noticed that their API supports selecting multiple sites at the same time, so you could add 7 datasets and use the API URL for one call for all of them at once.

image

amabdallah commented 1 year ago

Update form Justin

Wanted to give you another quick update. We have API access enabled now, so a data export URL will be available via the Export tab.

Example SiteID=FSPO2 https://data-owrb.aquaticinformatics.net/Export/DataSet?DataSet=Discharge.Mean%20Daily%40FSPO2&Calendar=CALENDARYEAR&DateRange=EntirePeriodOfRecord&UnitID=119&Conversion=Aggregate&IntervalPoints=Daily&ApprovalLevels=True&Qualifiers=undefined&Step=1&ExportFormat=csv&Compressed=true&RoundData=False&GradeCodes=False&InterpolationTypes=False&Timezone=-6&_=1693251294966

rwjam commented 1 year ago

Downloaded individual files for site info, will plan on stitching them together (roughly 16 sites for discharge)

For timeseries info, this should work. Do this as string to get timeseries info

"https://data-owrb.aquaticinformatics.net/Export/BulkExport?DateRange=EntirePeriodOfRecord&TimeZone=-6&Calendar=CALENDARYEAR&Interval=PointsAsRecorded&Step=1&ExportFormat=csv&TimeAligned=True&RoundData=False&IncludeGradeCodes=False&IncludeApprovalLevels=True&IncludeQualifiers=undefined&IncludeInterpolationTypes=False&Datasets[0].DatasetName=Discharge.Mean%20Daily%40" + LocationIdentifier from the stitch of site information

rwjam commented 7 months ago

pushed https://github.com/WSWCWaterDataExchange/MappingStatesDataToWaDE2.0/commit/0f5d6f075b72755e92d8bab94a513443ad909998