This PR (which is to the still-open measure-subdomains branch, which will close soon) updates a few things:
Includes .fed.us in the list of suffixes during subdomain discovery. This makes use of a new multi-suffix feature in domain-scan to discover domains with multiple suffixes simultaneously.
It also explicitly skips loading fed.us as its own Domain, since it's not actually a registerable domain. This wasn't causing an active problem, as there are no websites at https://fed.us (nor should there be), but I wanted to be more explicit in the code instead of it just accidentally working. I believe the .gov registry should probably exclude the row for fed.us as a domain from the .gov listings. (It should still include fs.fed.us and the other registered fed.us domains.)
Updates the use of domain-scan flags with changes made as part of a recent refactor, such as moving from --force to --cache, and using sslyze-certs=false instead of --sslyze-no-certs.
Adds support for passing through a --lambda flag to make use of Lambda for (subdomain-only) scanning with pshtt and sslyze. Lambda is not used in production and this flag isn't used in the cron-driven process, but it's there for development and testing, and there so the switch can easily be flipped in-future.
This PR (which is to the still-open
measure-subdomainsbranch, which will close soon) updates a few things:Includes
.fed.usin the list of suffixes during subdomain discovery. This makes use of a new multi-suffix feature in domain-scan to discover domains with multiple suffixes simultaneously.It also explicitly skips loading
fed.usas its own Domain, since it's not actually a registerable domain. This wasn't causing an active problem, as there are no websites athttps://fed.us(nor should there be), but I wanted to be more explicit in the code instead of it just accidentally working. I believe the .gov registry should probably exclude the row forfed.usas a domain from the .gov listings. (It should still includefs.fed.usand the other registeredfed.usdomains.)Updates the use of domain-scan flags with changes made as part of a recent refactor, such as moving from
--forceto--cache, and usingsslyze-certs=falseinstead of--sslyze-no-certs.Adds support for passing through a
--lambdaflag to make use of Lambda for (subdomain-only) scanning withpshttandsslyze. Lambda is not used in production and this flag isn't used in the cron-driven process, but it's there for development and testing, and there so the switch can easily be flipped in-future.