canada-ca / tracker

Track Government of Canada domains for adherence to digital security best practices and federal requirements.
38 stars 9 forks source link

Add concurrent scanning to scanners #3472

Open FestiveKyle opened 2 years ago

FestiveKyle commented 2 years ago

Currently domains are scanned one at a time. Much of the time taken to scan a domain is spent on waiting for a response, so we should enable multiple scans to take place at the same time.

Example of how to enable this is in PR #3471 (linked)

h701h commented 2 years ago

As we move forward with this. I'd like to know more about levers we can pull that affect our monthly costs. For example, scanning non-stop around the clock is more expensive compared to only scanning on demand. Are there other levers?