search

18F / domain-scan

A lightweight pipeline, locally or in Lambda, for scanning things like HTTPS, third party service use, and web accessibility.
Other
370 stars 137 forks source link

Add a User-Agent to the pagedata scan. #322

Closed alexbielen closed 4 years ago

alexbielen commented 4 years ago

See: Spotlight Project Issue

Why: In order to mitigate AWS Abuse reports, add a user-agent to the pagedata scan.

How: Updating scanners/pagedata.py

Tags: user-agent, requests