analyze meta redirect data

[gbinal]

The data being generated by #1037 needs to be looked at in context of the wider scan information. I'll capture my notes on it here.

[gbinal]

Doing this here.

• 1,752 out of 28,883 have a meta-redirect=TRUE.
• Of those, 1,538 had their primary scans complete. 214 had them fail.
  - What is distinct about those 214?
• 16,842 out of 28,883 have meta-redirect=FALSE.
• Of those, 16,123 had their primary scans complete. 719 failed.
  - What distinguishes them? - Also, 653 of those 719 are timeouts. I suspect that many of these should be marked TRUE, not FALSE.
  • Examples of false negatives - dmidservices.niaid.nih.gov, dmidservices.niaid.nih.gov, guid.nih.gov
• 10289 out of 28,883 did not successfully complete a client redirect scan.
  **- Of those, 577 did complete their primary scans.
  • Why would that be?**
  • Of those, 9,712 had their primary scans fail.
    - 2,521 of those timed out. I suspect that some number of these should have been marked meta-redirect=TRUE.
    • Examples that I've found: aas.gsa.gov, aea.faa.gov, digital.va.gov