Adding several domains for Department of Education

jsf9k commented 6 years ago

NCATS received a big list of domains to add for Department of Education.

jsf9k commented 6 years ago

Good catch, @h-m-f-t!

jsf9k commented 6 years ago

Any movement on this one, @h-m-f-t?

h-m-f-t commented 6 years ago

@jsf9k I'll kickoff a pshtt scan of these domains and will analyze the results. At worst, we can merge the .gov domains without too much trouble.

I'll aim to clear this from my queue this week.

h-m-f-t commented 6 years ago

I did a few things to arrive at this list.

ran a pshtt scan on all the ED additions, which gave me redirect and other info
removed second-level .gov domains we already scan for
browsed to the remaining hostnames (or interacted with them via other tools)
looked for signs the host was owned by ED (and didn't belong to a non-ED owned SaaS):
- had a "WARNING Government system" banner
- served a DAP file
- sole purpose appears to be to redirect to a ED .gov system

The raw analysis is here. I did this quickly; there may errors here but I'm comfortable enough with this moving forward.

cc: @tdlowden, there may be some interest in getting:

non-.gov ED sites that are serving DAP code to be accepted as official ED sites in DAP (mostly the grads360.org sites)
getting the ED sites we're adding to this list that don't serve DAP to do so (if the DAP? value is empty, I didn't evaluate.)

jsf9k commented 6 years ago

This looks fine to me, @h-m-f-t.

GSA / data