edgi-govdata-archiving / web-monitoring

Documentation and project-wide issues for the Website Monitoring project (a.k.a. "Scanner")
Creative Commons Attribution Share Alike 4.0 International
105 stars 17 forks source link

Add PFAS pages #148

Closed gretchengehrke closed 4 years ago

gretchengehrke commented 4 years ago

Hi Rob! I'm not sure if "issues" is the right place to put this, but is there any chance you could add EPA's PFAS pages to Scanner, tagged "research" (or epa.gov--research, however you get it in that domain)? No rush on timing, and sorry for making a request literally the day after your paid hours ended! The pages are: https://www.epa.gov/chemical-research/research-and-polyfluoroalkyl-substances-pfas https://www.epa.gov/chemical-research/status-epa-research-and-development-pfas https://www.epa.gov/pfas/epas-pfas-action-plan https://www.epa.gov/water-research/pfas-methods-and-guidance-sampling-and-analyzing-water-and-other-environmental-media https://www.epa.gov/chemical-research/pfas-research-summary https://www.epa.gov/chemical-research/technologies-reducing-pfas-drinking-water-fact-sheet https://www.epa.gov/sciencematters/understanding-pfas-environment https://www.epa.gov/sciencematters/reducing-pfas-drinking-water-treatment-technologies https://www.epa.gov/sciencematters/epa-researchers-use-innovative-approach-find-pfas-environment https://www.epa.gov/sciencematters/epa-toxicologists-focus-innovative-research-pfas-compounds https://comptox.epa.gov/dashboard/chemical_lists/EPAPFASRESEARCH https://www.epa.gov/pfas https://www.epa.gov/pfas/basic-information-pfas https://www.epa.gov/pfas/epa-actions-address-pfas https://www.epa.gov/pfas/pfas-national-leadership-summit-and-engagement https://www.epa.gov/pfas/pfas-laws-and-regulations https://www.epa.gov/pfas/pfas-communication-and-outreach-tools https://www.epa.gov/pfas/epa-pfas-data-and-tools https://www.epa.gov/pfas/us-state-resources-about-pfas https://www.epa.gov/pfas/site-specific-information https://www.epa.gov/pfas/treating-pfas-drinking-water https://www.epa.gov/pfas/pfas-what-you-need-know-infographic

Mr0grog commented 4 years ago

I'm not sure if "issues" is the right place to put this

This is perfect! 👍

tagged "research" (or epa.gov--research, however you get it in that domain)

So we can have any number of tags with any name, but we also have a set of tags named tag2:<whatever> (e.g. tag2:air) that are used when grouping CSVs in the weekly output (so spreadsheets are named <domain>--<tag2_value>.csv). Which kind of tag do you want? (We can do both — pages have multiple tags.)

gretchengehrke commented 4 years ago

Oh great -- that's what I thought re: tagging. I'd love them tagged tag2:research then. Thank you!

Mr0grog commented 4 years ago

This is all set: