Write Scraping Script

[MicheleTobias]

• [x] Write a script to scrape the data from the UC Davis Potential Worksite Exposure Reporting (AB 685) site.
• [ ] Add any new data to the data previously scraped

This site has a few challenges:

• It looks like they only keep a couple of weeks of data on the site so older data is removed
• They update the data retroactively (as they find them), so new data might get added into the middle of the dataset

[MicheleTobias]

I made a script file - scrape_exposure_data.R - with the goals and tasks for the script at the top in a comment. This also let me set up the folder structure we need for the repo. Work in this file to write the scraping code.

[MicheleTobias]

@erklopez I learned some things yesterday making a demo web map. Here's a list:

1. We need to add additional columns for the start and end of the exposure period called "start" and "end" - lower case (and without the quotes) - for the timeline tool I'm using to read it.
2. The date format should be 09-10-2021 - with dashes and not slashes

For cleaning up the building names, let's keep the original names and add a column for what we change it to.

Here's what I think the columns will need to be in the final csv:

• report_date (original data from the website)
• worksite (original data from the website)
• location (original data from the website)
• potential_exposure_dates (original data from the website)
• campus_building (the official name from the campus buildings data, determined from the worksite column)
• start (parsed from potential_exposure_dates column)
• end (parsed from potential_exposure_dates column)

[MicheleTobias]

Great teamwork on writing this code! I appreciate the way everyone communicated where they were at in their process and commented their code so anyone could pick up where another person left off.