California-Data-Collaborative / cadc_reservoir_explorer

An agile approach to visualizing California's reservoir levels in real-time.
MIT License
5 stars 0 forks source link

Update README #2

Closed vr00n closed 7 years ago

vr00n commented 7 years ago

Hey @dmarulli - could you add a brief overview writeup for this that includes ...the data items that powers the viz?

patwater commented 7 years ago

The parsing actually was courtesy of @anthonycarlos92 . See here for his Seed Consulting code: https://github.com/anthonycarlos92/waterlog_project_rest_api/blob/master/helpers/swp_reservoir_scraper.py

Here's the key bit where he cycles through the reservoir id's:

requests.get('http://cdec.water.ca.gov/cgi-progs/profile?s=%s&type=dam' % station_id) request_soupified = BeautifulSoup(swp_client_request_meta_data.text, "html.parser")

Pulls from CDEC here and see here for more water resources data sources that would be cool to parse and make slick viz's of in the future

christophertull commented 7 years ago

Could probably repurpose some of that code into parsekit format if desired.

patwater commented 7 years ago

This still needed? If not can we close?