Automating field notes using mWater

[SamStruthers]

mWater is a survey platform used by CU folks to record field note visits. Data is stored in a datagrid associated with a survey on the mWater portal. These data can be downloaded using an API url (mWater api yml) This PR has three main files which all live in the folder mWater_collate:

• mWater_pull_collate.rmd: main file which pulls data from mWater API and breaks it into three main sections: all_notes, sensor_notes, sampling_notes.

Dataframes: All notes is everything submitted, sensor_notes is only visits where sensor was interacted with, sampling notes is when water sampling occured.

Actions: save sensor notes to csv in data folder this is how we can maintain a backup of the data from mWater. This code also uses the photo_download and sampling spreadsheet creator functions (described below)

• photo_downloader.R: grabs all the download urls from the all notes sheet and will download+rename all the photos uploaded to mWater. It should not download any photos if they have already been downloaded
• sampling_spreadsheet_creator.R: formats a days worth of water sampling data to match RMRS formatting. This is mainly a tool that I will use after a field day to speed up sample input and make sure I don't create any typos in the RMRS masterfile.

Review Requested:

• I will send you the API yml. Please test to make sure the whole pipeline works by running all the chunks (keeping in mind that photo downloader wont do anything since I already downloaded the photos)
• The code is not very concise, especially photo downloader so any suggestions on that would be helpful
• Check to make sure I mimic'ed the existing structure of our field notes in QAQC pipeline (start_dt, round_dt, sensor employed, etc)
• general notes on conciseness of rmd file and any sections that seem confusing

[SamStruthers]

Thanks for the notes. I'll make some changes to the scripts to make it clear that sensor_notes is what we will be pulling into the QAQC script.

[SamStruthers]

Big Improvement (IMO):

• Improved API pull (no raw mWater file anymore)
• all_notes_cleaned is the df that is used downstream and only has a few minor corrections from API pull
• readability is improved and sensor notes is the only other dataframe created
• Finished log/cal report check function: This checks the data folder to see if users have uploaded the logs/cal reports that they claim to in the mWater survey
• Moved all water sampling dataframes into the sampling spreadsheet function as they are not needed in the main rmd. Users can now save all the water sampling info as csv or just a day in RMRS formatting
• Fixed the nrow comment in download pictures.R

Review Requested:

• See if it works! If you want to submit any extra mWater surveys to test something specific, we can delete them later no problem

[SamStruthers]

I added a new file scratch/data_tidying/timelapse_folder_rename.R This is mostly an tool that I will use when I get SD cards from our timelapse cameras. It essentially prompts the user for the site name after showing a picture from the folder in the timelapse_raw folder. Based on the response and the first and last photo in the folder, it renames the folder to match our syntax and then moves said folder to the timelapse_photos folder.

No review required since I will be the main user of this and it does not affect our larger workflow unless anyone feels strongly about this....