search

DOI-USGS / national-flow-observations

This repository pulls national flow data from NWIS
Other
4 stars 8 forks source link

Notes on target build time #4

Open limnoliver opened 4 years ago

limnoliver commented 4 years ago

10_nwis_pull/inout/nwis_dv_inventory.rds Retrieves all flow sites from NWISdv, completes in 3.36 minutes

limnoliver commented 4 years ago

10_nwis_pull/inout/nwis_uv_inventory.rds Retrieves all flow sites from NWISuv, completes in 2.85 minutes

lindsayplatt commented 4 years ago

10_nwis_pull/out/nwis_dv_data.rds Retrieves all flow data for DV sites from NWISdv, completes in 1342 minutes (~22 hrs)

lindsayplatt commented 4 years ago

10_nwis_pull/out/nwis_uv_data.rds Retrieves all flow data for UV sites from NWISuv, completes in 1133 minutes (~18 hrs)

lindsayplatt commented 4 years ago

20_data_munge/out/daily_flow.rds Summarizes the UV data into mean daily values and then merges the DV and UV data. Completes in 21.48 minutes

lindsayplatt commented 4 years ago

30_data_summarize/out/active_flow_gages.rds Summarizes all of the flow values to get a count of gages that had >335 daily obs per year, completes in 15.93 minutes

lindsayplatt commented 4 years ago

30_data_summarize/out/active_flow_gages_summary.rds.ind Summarizes information about each gage that is considered "active" for at least one year in NWIS, completes in 4.26 minutes

lindsayplatt commented 4 years ago

10_nwis_pull/out/nwis_pull_diagnostics.yml Summarizes some diagnostic information about how much data and how many sites were included in the nwis data pull, completes in 5.72 minutes

30_data_summarize/out/active_flow_gages_diagnostics.png Creates a plot summarizing active gages through time + notes some numeric counts/dates about continuous vs active gages. Completes in 0.08 minutes