search

18F / site-scanning

The code base for the first Site Scanning engine
https://digital.gov/site-scanning
18 stars 9 forks source link

Re-consider adding a user-agent to the v2 scanner #840

Closed gbinal closed 3 years ago

gbinal commented 3 years ago

The v1 scanner (phases 1-3) triggered some abuse reports with AWS that prompted the need to add a user-agent to help identify the traffic to agencies monitoring their traffic.

It doesn't appear that the v2 scanner will face the same issues, for a few reasons (running straight out of chrome, and only doing ~4 hits instead of ~25-30/day, so we don't feel the need to add a user agent to v2 for now. It may still be a good idea that we should return to at some point.

gbinal commented 3 years ago

Closing this until it comes up again (hopefully far in the future or never!). :)