adds a cross walk to 2_crosswalk_munge that matches the Univ MO state level ID system to NHDHR
adds University of MO data to all_dat_linked.feather (closes #269)
updates the Bull Shoals parser to crosswalk with the Univ. Mo crosswalk (raw data and final xwalk) (updates #218, will manually update after merge)
updates tidyr::gather to tidyr::pivot_longer (closes #262)
adds the Norfork sf rds to getters.yaml (closes #287)
successfully runs the pipeline through scmake("8_viz")
The raw data from University of Missouri has 56,708 records. Approximately 33% of these records (18,599) make it into all_coop_dat_linked.feather. This relatively poor conversion rate is likely due to the point-in-polygon method used to crosswalk the state ID system used to the NHDHR system. This issue is documented in #289. Because of the issue, only data from three reservoirs makes it into the final data set: Mark Twain Res., Lake Stockton, and Truman Res.
Modifying the Bull Shoals parser resulted in 5,780 additional records for 73 unique DateTime values.
Finally, while I was poking around in crosswalk_coop_dat I took a few minutes to convert tidyr::gather to tidyr::pivot_longer. tidyr::gather was superceded by pivot_longer a few years ago and I didn't want to wait until it was removed from the package.
After completing the above, we pick up 3 more PGDL lakes (compared to #284). Snapshot of 8_viz/out/lakes_summary_fig.html:
This pull request completes the following:
2_crosswalk_mungethat matches the Univ MO state level ID system to NHDHRall_dat_linked.feather(closes #269)tidyr::gathertotidyr::pivot_longer(closes #262)getters.yaml(closes #287)scmake("8_viz")The raw data from University of Missouri has 56,708 records. Approximately 33% of these records (18,599) make it into
all_coop_dat_linked.feather. This relatively poor conversion rate is likely due to the point-in-polygon method used to crosswalk the state ID system used to the NHDHR system. This issue is documented in #289. Because of the issue, only data from three reservoirs makes it into the final data set: Mark Twain Res., Lake Stockton, and Truman Res.Modifying the Bull Shoals parser resulted in 5,780 additional records for 73 unique
DateTimevalues.Finally, while I was poking around in
crosswalk_coop_datI took a few minutes to converttidyr::gathertotidyr::pivot_longer.tidyr::gatherwas superceded bypivot_longera few years ago and I didn't want to wait until it was removed from the package.After completing the above, we pick up 3 more PGDL lakes (compared to #284). Snapshot of
8_viz/out/lakes_summary_fig.html: