GSA / site-scanning

The central repository for the Site Scanning program
https://digital.gov/site-scanning
12 stars 2 forks source link

investigate various .mil sites being filtered out of the index creation process #967

Closed gbinal closed 5 months ago

gbinal commented 6 months ago

From here...

101arw.ang.af.mil 102iw.ang.af.mil 103aw.ang.af.mil 104fw.ang.af.mil 105aw.ang.af.mil 106rqw.ang.af.mil 107attackwing.ang.af.mil 108thwing.ang.af.mil 109aw.ang.af.mil 10af.afrc.af.mil 10millionpatents.uspto.gov 10thaamdc.army.mil 10thmarines.marines.mil 110wg.ang.af.mil 111attackwing.ang.af.mil 113wg.ang.af.mil 114fw.ang.af.mil 115fw.ang.af.mil 116acw.ang.af.mil 117arw.ang.af.mil 118wg.ang.af.mil 119wg.ang.af.mil 11thairbornedivision.army.mil 11thmeu.marines.mil 120thairliftwing.ang.af.mil 121arw.ang.af.mil 122fw.ang.af.mil 123aw.ang.af.mil 124thfighterwing.ang.af.mil 125fw.ang.af.mil 126arw.ang.af.mil 127wg.ang.af.mil 128arw.ang.af.mil 129rqw.ang.af.mil 12af.acc.af.mil 12cab.army.mil 12ftw.af.mil 12thmcd.marines.mil 130aw.ang.af.mil 131bw.ang.af.mil 132dwing.ang.af.mil 133aw.ang.af.mil 134arw.ang.af.mil 136aw.ang.af.mil 137sow.ang.af.mil 138fw.ang.af.mil 139aw.ang.af.mil 13thmeu.marines.mil 140wg.ang.af.mil 141arw.ang.af.mil 142wg.ang.af.mil 143aw.ang.af.mil 144fw.ang.af.mil 145aw.ang.af.mil 146aw.ang.af.mil 147atkw.ang.af.mil 148fw.ang.af.mil 149fw.ang.af.mil 150sow.ang.af.mil 151arw.ang.af.mil 152aw.ang.af.mil 153aw.ang.af.mil 154wg.ang.af.mil 155arw.ang.af.mil 156wg.ang.af.mil 157arw.ang.af.mil 158fw.ang.af.mil 159fw.ang.af.mil 15af.acc.af.mil 15thmeu.marines.mil 15wing.af.mil 161arw.ang.af.mil 162wing.ang.af.mil 163atkw.ang.af.mil 164aw.ang.af.mil 165aw.ang.af.mil 166aw.ang.af.mil 167aw.ang.af.mil 168wg.ang.af.mil 169fw.ang.af.mil 16af.af.mil 171arw.ang.af.mil 172aw.ang.af.mil 173fw.ang.af.mil 174attackwing.ang.af.mil 176wg.ang.af.mil 177fw.ang.af.mil 178wing.ang.af.mil 180fw.ang.af.mil 182aw.ang.af.mil 183wg.ang.af.mil 184iw.ang.af.mil 185arw.ang.af.mil 186arw.ang.af.mil 187fw.ang.af.mil 188wg.ang.af.mil 189aw.ang.af.mil 18af.amc.af.mil 190arw.ang.af.mil 192wg.ang.af.mil 193sow.ang.af.mil 194wg.ang.af.mil 195wg.ang.af.mil 19bcd.army.mil 1af.acc.af.mil 1stmardiv.marines.mil 1stmaw.marines.mil 1stmcd.marines.mil 1stmlg.marines.mil 1tsc.army.mil 20af.af.mil 20cbrne.army.mil 21tsc.army.mil 22af.afrc.af.mil 22ndmeu.marines.mil 24thmeu.marines.mil 26thmeu.marines.mil 29palms.marines.mil 2af.aetc.af.mil 2cr.army.mil 2id.korea.army.mil 2ndmardiv.marines.mil 2ndmarines.marines.mil 2ndmaw.marines.mil 2ndmlg.marines.mil 2sigbde.army.mil 301fw.afrc.af.mil 302aw.afrc.af.mil 307bw.afrc.af.mil 310sw.afrc.af.mil 315aw.afrc.af.mil 31stmeu.marines.mil 33fw.af.mil 349amw.afrc.af.mil 352sow.af.mil 353sow.af.mil 37trw.af.mil 388fw.acc.af.mil 3rdmardiv.marines.mil 3rdmaw.marines.mil 3rdmeb.marines.mil 3rdmlg.marines.mil 403wg.afrc.af.mil 409csb.army.mil 413ftg.afrc.af.mil 419fw.afrc.af.mil 41fab.army.mil 433aw.afrc.af.mil 442fw.afrc.af.mil 445aw.afrc.af.mil 446aw.afrc.af.mil 459arw.afrc.af.mil 477fg.afrc.af.mil 492sow.af.mil 4af.afrc.af.mil 4thmcd.marines.mil 501csw.usafe.af.mil 505ccw.acc.af.mil 507arw.afrc.af.mil 512aw.afrc.af.mil 514amw.afrc.af.mil 521amow.af.mil 53rdwing.af.mil 552acw.acc.af.mil 557weatherwing.af.mil 55comcam.army.mil 5af.pacaf.af.mil 618tacc.amc.af.mil 624rsg.afrc.af.mil 6thmarines.marines.mil 6thmcd.marines.mil 7af.pacaf.af.mil 7atc.army.mil 8af.af.mil 8thmarines.marines.mil 8thmcd.marines.mil 908aw.afrc.af.mil 913ag.afrc.af.mil 916arw.afrc.af.mil 919sow.afrc.af.mil 920rqw.afrc.af.mil 926wing.afrc.af.mil 927arw.afrc.af.mil 931arw.afrc.af.mil 932aw.afrc.af.mil 940arw.afrc.af.mil 944fw.afrc.af.mil 960cyber.afrc.af.mil 9thmcd.marines.mil aatc.ang.af.mil acc.af.mil acmc.marines.mil acq.osd.mil adr.af.mil aepubs.eur.army.mil aetc.af.mil af.mil afaa.af.mil afams.af.mil afcec.af.mil afcent.af.mil afdw.af.mil afgsc.af.mil afhistory.af.mil afhistoryandmuseums.af.mil afhra.af.mil afimsc.af.mil afinspectorgeneral.af.mil afjag.af.mil aflcmc.af.mil afmaa.af.mil afmc.af.mil afnwc.af.mil afod.eur.army.mil afotec.af.mil afpc.af.mil afrc.af.mil afrims.health.mil afrl.af.mil afsbeurope.army.mil afsbirsttr.af.mil afsc.af.mil afsfc.af.mil afsoc.af.mil afspc.af.mil aft3.af.mil aftc.af.mil afwerx.af.mil agc.army.mil aiaccelerator.af.mil airdomainintelligence.mil airforceacademy.tricare.mil airforcebes.af.mil airforcemedicine.af.mil airforcesmallbiz.af.mil airforcespecialtactics.af.mil airlant.usff.navy.mil airman.af.mil airmanmagazine.af.mil airpac.navy.mil ak.ng.mil al.ng.mil albany.marines.mil allhands.navy.mil alpenacrtc.ang.af.mil alsa.mil altus.af.mil altus.tricare.mil amc.af.mil amc.army.mil amcom.army.mil amlc.army.mil amphib7flt.navy.mil anacostiabolling.tricare.mil andersen.tricare.mil andrews.tricare.mil ang.af.mil angtec.ang.af.mil annapolis.tricare.mil ar.marines.mil arcp.army.mil arcyber.army.mil arkansas.nationalguard.mil army.nationalguard.mil armyupress.army.mil arnold.af.mil arnorth.army.mil arpc.afrc.af.mil arsouth.army.mil asafm.army.mil asb.army.mil aschq.army.mil at.dod.mil atlantic.navfac.navy.mil atlanticarea.uscg.mil aviano.af.mil aviano.tricare.mil aviation.marines.mil avmc.army.mil awg.army.mil bamc.tricare.mil band.eur.army.mil barksdale.af.mil barksdale.tricare.mil barquist.tricare.mil barracks.marines.mil basictraining.af.mil bassett-wainwright.tricare.mil bayne-jones.tricare.mil beale.af.mil beale.tricare.mil beaufort.marines.mil beaufort.tricare.mil belvoirhospital.tricare.mil beready.af.mil bg-crawford.tricare.mil bic.marines.mil blanchfield.tricare.mil bmtflightphotos.af.mil bracpmo.navy.mil bremerton.tricare.mil briandallgood.tricare.mil buckley.spaceforce.mil buckley.tricare.mil c2f.usff.navy.mil c3f.navy.mil c6f.navy.mil c7f.navy.mil cac.mil calmed.tricare.mil camp-lejeune.tricare.mil camp-pendleton.tricare.mil campedwards.ng.mil cannon.af.mil cannon.tricare.mil cbirf.marines.mil ccad.army.mil ccsg15.navy.mil cd.marines.mil cdi.marines.mil centcom.mil charleston.tricare.mil cherrypoint.marines.mil cherrypoint.tricare.mil cloud.mil clwp.navy.mil cmc.marines.mil cnic.navy.mil cnmoc.usff.navy.mil cnrc.navy.mil cnreurafcent.cnic.navy.mil cnrh.cnic.navy.mil cnrj.cnic.navy.mil cnrk.cnic.navy.mil cnrma.cnic.navy.mil cnrnw.cnic.navy.mil cnrse.cnic.navy.mil cnrsw.cnic.navy.mil co.ng.mil columbus.af.mil columbus.tricare.mil compliance.af.mil corpuschristi.tricare.mil cpf.navy.mil cprw1.navy.mil creech.af.mil csg4.usff.navy.mil csp.navy.mil ct.ng.mil cusnc.navy.mil cyber.army.mil cybercom.mil cyberdefensereview.army.mil cyberspacecapabilitiescenter.af.mil daaf-wx.army.mil darnall.tricare.mil dasadec.army.mil data.af.mil davismonthan.tricare.mil dc.ng.mil dc3.mil dcaa.mil dcma.mil dcms.uscg.mil dcms.uscg.mil dco.uscg.mil dcsa.mil dcsa.mil de.ng.mil defenseculture.mil defensesbirsttr.mil desmond-doss.tricare.mil dfas.mil dhra.mil dia.mil diegogarcia.tricare.mil dimoc.mil dinfos.dma.mil dla.mil dm.af.mil dma.mil dobbins.afrc.af.mil doctrine.af.mil dodcui.mil dodig.mil dodmantech.mil dodsoco.ogc.osd.mil doha.ogc.osd.mil dote.osd.mil dover.af.mil dover.tricare.mil dpaa.mil drumcorps.marines.mil dsp.dla.mil dspo.mil dtra.mil dunham.tricare.mil dyess.af.mil dyess.tricare.mil e-publishing.af.mil eads.ang.af.mil edwards.af.mil edwards.tricare.mil eglin.af.mil eglin.tricare.mil eielson.af.mil eielson.tricare.mil eisenhower.tricare.mil ellsworth.af.mil ellsworth.tricare.mil elmendorfrichardson.tricare.mil erdc.usace.army.mil esd.whs.mil europeafrica.army.mil evanmills.lbl.gov evans.tricare.mil ewtgpac.navy.mil expeditionarycenter.af.mil exwc.navfac.navy.mil fairchild.af.mil fairchild.tricare.mil fcc.navy.mil fermilinux.fnal.gov fewarren.tricare.mil ffr.cnic.navy.mil first.army.mil fitness.marines.mil forcecom.uscg.mil fourthfleet.navy.mil frcse.navair.navy.mil frcsw.navair.navy.mil ftig.ng.mil fuji.marines.mil futures.af.mil ga.ng.mil goarmysof.army.mil goodfellow.af.mil goodfellow.tricare.mil gosere.af.mil grandforks.af.mil grandforks.tricare.mil grissom.afrc.af.mil gu.ng.mil guam.tricare.mil guantanamo.tricare.mil gulfportcrtc.ang.af.mil guthrie.tricare.mil hanscom.af.mil hanscom.tricare.mil hill.af.mil hill.tricare.mil history.uscg.mil hnc.usace.army.mil holloman.af.mil holloman.tricare.mil homestead.afrc.af.mil honorguard.af.mil hospitals.millionhearts.hhs.gov housing.af.mil hqmc.marines.mil hqrio.afrc.af.mil hrom.marines.mil hurlburt.af.mil hurlburt.tricare.mil hypertension.millionhearts.hhs.gov iandl.marines.mil ig.army.mil igmc.marines.mil iiimef.marines.mil iimef.marines.mil il.ngb.army.mil imef.marines.mil incirlik.af.mil incirlik.tricare.mil inherentresolve.mil innovation.army.mil insurv.usff.navy.mil ireland.tricare.mil irwin.tricare.mil iwr.usace.army.mil jacksonville.tricare.mil jag.navylive.dodlive.mil jagreporter.af.mil japan.marines.mil jba.af.mil jbab.jb.mil jbcharleston.jb.mil jber.jb.mil jble.af.mil jblmdesignstandards.army.mil jbmdl.jb.mil jbsa.mil jcs.mil jcu.mil jiatfs.southcom.mil jpeoaa.army.mil jpeocbrnd.osd.mil jpra.mil jrm.cnic.navy.mil jtf-spacedefense.mil jtfb.southcom.mil jtfcs.northcom.mil jtfgtmo.southcom.mil jtfn.northcom.mil jtnc.mil jwac.mil kadena.af.mil kadena.tricare.mil keesler.af.mil keesler.tricare.mil keller.tricare.mil kenner.tricare.mil kimbrough.tricare.mil kirk.tricare.mil kirtland.af.mil kirtland.tricare.mil kunsan.af.mil kunsan.tricare.mil ky.ng.mil lakenheath.af.mil landstuhl.tricare.mil langleyeustis.tricare.mil laughlin.tricare.mil lawenforcement.marines.mil learningprofessionals.af.mil lejeune.marines.mil lemoore.tricare.mil leonard-wood.tricare.mil letterkenny.army.mil lewismcchord.tricare.mil littlerock.af.mil littlerock.tricare.mil logcom.marines.mil losangeles.spaceforce.mil losangeles.tricare.mil lrb.usace.army.mil lrc.usace.army.mil lrd.usace.army.mil lrh.usace.army.mil lrl.usace.army.mil lrn.usace.army.mil lrp.usace.army.mil luke.af.mil luke.tricare.mil lyster.tricare.mil macdill.af.mil macdill.tricare.mil macg28.marines.mil madigan.tricare.mil mag14.marines.mil mag26.marines.mil mag29.marines.mil mag31.marines.mil malmstrom.af.mil malmstrom.tricare.mil marcent.marines.mil march.afrc.af.mil marcorsyscom.marines.mil marforcom.marines.mil marforcyber.marines.mil marforeur.marines.mil marfork.marines.mil marforres.marines.mil marforsouth.marines.mil marineband.marines.mil marines.mil mars.af.mil marsoc.marines.mil martin.tricare.mil maxwell.af.mil maxwell.tricare.mil mcasfutenma.marines.mil mcasiwakuni.marines.mil mcasiwakunijp.marines.mil mcaspendleton.marines.mil mcasyuma.marines.mil mcbblaz.marines.mil mcbbutler.marines.mil mcbhawaii.marines.mil mcchord.af.mil mcconnell.af.mil mcconnell.tricare.mil mcdonald.tricare.mil mcguiredixlakehurst.tricare.mil mcicom.marines.mil mcieast.marines.mil mcipac.marines.mil mciwest.marines.mil mcjrotc.marines.mil mclbbarstow.marines.mil mcrc.marines.mil mcrdpi.marines.mil mcrdsd.marines.mil mcsf-nola.marines.mil mcsfr.marines.mil mcwl.marines.mil me.ng.mil med.navy.mil medlinet.amedd.army.mil mepcom.army.mil metc.mil mhs-europe.tricare.mil mildenhall.af.mil minationalguard.dodlive.mil minneapolis.afrc.af.mil minot.af.mil minot.tricare.mil miramar-ems.marines.mil miramar.marines.mil misawa.af.mil misawa.tricare.mil modsim.af.mil moguard.ngb.mil moncrief.tricare.mil moody.af.mil moody.tricare.mil mortuary.af.mil mountainhome.af.mil mountainhome.tricare.mil mrc-europe.army.mil mrdg.health.mil msc.usff.navy.mil munson.tricare.mil music.af.mil music.marines.mil mvd.usace.army.mil mvm.usace.army.mil mvn.usace.army.mil myafn.dodlive.mil mycg.uscg.mil mynavyhr.navy.mil nab.usace.army.mil nae.usace.army.mil nan.usace.army.mil nao.usace.army.mil nap.usace.army.mil naples.tricare.mil nasic.af.mil nationalguard.mil nationalmuseum.af.mil nau.usace.army.mil navalaviationnews.navylive.dodlive.mil navalsafetycommand.navy.mil navfac.navy.mil navifor.usff.navy.mil navsea.navy.mil navsup.navy.mil navy.mil navyreserve.navy.mil ncc.navfac.navy.mil ncgm.uscg.mil ncis.navy.mil ncolcoe.army.mil ncoworldwide.army.mil ndw.cnic.navy.mil necc.usff.navy.mil nellis.af.mil nellis.tricare.mil nepa.navy.mil netc.navy.mil netcents.af.mil newengland.tricare.mil newriver.marines.mil news.uscg.mil newsroom.tricare.mil ngbpmc.ng.mil nh.ng.mil nhc-charleston.tricare.mil nhchawaii.tricare.mil niagara.afrc.af.mil njang.ang.af.mil norad.mil northcom.mil nrl.navy.mil nsw.navy.mil nwd.usace.army.mil nwdc.usff.navy.mil nwk.usace.army.mil nwo.usace.army.mil nwp.usace.army.mil nws.usace.army.mil nww.usace.army.mil oakharbor.tricare.mil obtportal.army.mil offutt.af.mil offutt.tricare.mil oig.dia.mil ok.ng.mil okinawa.marines.mil okinawa.tricare.mil oni.navy.mil osan.af.mil osan.tricare.mil osi.af.mil outreach.navy.mil p2p.navy.mil pa.ng.mil pacaf.af.mil pacific.navfac.navy.mil pacificarea.uscg.mil pacom.mil patrick.spaceforce.mil patrick.tricare.mil paxriver.tricare.mil pearlharborhickam.tricare.mil pendleton.marines.mil pensacola.tricare.mil peols.marines.mil peosoldier.army.mil peterson.tricare.mil petersonschriever.spaceforce.mil pfpa.mil phcp.health.mil pittsburgh.afrc.af.mil plainsguardian.dodlive.mil poa.usace.army.mil pod.usace.army.mil pof.usace.army.mil poh.usace.army.mil poj.usace.army.mil pope.af.mil pope.tricare.mil portsmouth.tricare.mil privacy.af.mil prs.mil pscc.army.mil psmagazine.army.mil publicaccess.dtic.mil publicaffairs.af.mil publications.usace.army.mil quantico.marines.mil quantico.tricare.mil rader.tricare.mil rafalconbury.tricare.mil rafcroughton.tricare.mil raflakenheath.tricare.mil ramstein.af.mil ramstein.tricare.mil raymond-bliss.tricare.mil ready.marines.mil ready.navy.mil recruiting.af.mil recruiting.army.mil redstone.tricare.mil repi.mil reserve.uscg.mil resilience.af.mil retirees.af.mil reynolds.tricare.mil rmc.usace.army.mil robins.af.mil robins.tricare.mil rodriguez.tricare.mil rota.tricare.mil sac.usace.army.mil sad.usace.army.mil safcn.af.mil safety.af.mil safety.marines.mil saffm.hq.af.mil safgc.hq.af.mil safia.hq.af.mil safie.hq.af.mil safsq.hq.af.mil saj.usace.army.mil sam.usace.army.mil sandiego.tricare.mil sas.usace.army.mil scguard.ng.mil schriever.spaceforce.mil scientificadvisoryboard.af.mil scott.af.mil scott.tricare.mil seabeemagazine.navylive.dodlive.mil seaport.navy.mil secretsdeclassified.af.mil seymourjohnson.af.mil seymourjohnson.tricare.mil sfb.dodlive.mil shaw.af.mil shaw.tricare.mil sheppard.af.mil sheppard.tricare.mil sigonella.tricare.mil skysoldiers.army.mil smdc.army.mil smmc.marines.mil smtc.dodlive.mil southcom.mil southcomclinic.tricare.mil spa.usace.army.mil spacecom.mil spaceforce.mil spangdahlem.af.mil spangdahlem.tricare.mil specialwarfaretw.af.mil spk.usace.army.mil spl.usace.army.mil spn.usace.army.mil spoc.spaceforce.mil srf.navy.mil ssc.spaceforce.mil starcom.spaceforce.mil stratcom.mil studyguides.af.mil sublant.usff.navy.mil surflant.usff.navy.mil surfpac.navy.mil swcs.mil swf.usace.army.mil swg.usace.army.mil swl.usace.army.mil tam.usace.army.mil tasa.dma.mil tecom.marines.mil tesseract.af.mil test-evaluation.osd.mil tf515.marines.mil tinker.af.mil tinker.tricare.mil tobyhanna.army.mil torch.aetc.af.mil trademark.af.mil travel.dod.mil travis.af.mil travis.tricare.mil tripler.tricare.mil trngcmd.marines.mil ttgp.navy.mil twentynine-palms.tricare.mil tyndall.af.mil tyndall.tricare.mil unc.mil usace.army.mil usafa.af.mil usafe.af.mil usafmcom.army.mil usanato.army.mil usapc.army.mil usar.army.mil usarcent.army.mil usarj.army.mil usarpac.army.mil uscg.mil usff.navy.mil usfj.mil usfk.mil usnhistory.navylive.dodlive.mil ut.ng.mil va.ng.mil vance.af.mil vance.tricare.mil vandenberg.spaceforce.mil vandenberg.tricare.mil veterans-in-blue.af.mil vi.ng.mil volkfield.ang.af.mil vt.public.ng.mil wads.ang.af.mil walterreed.tricare.mil warren.af.mil warriorcare.dodlive.mil wavelength.af.mil web.dma.mil weed-irwin.tricare.mil westover.afrc.af.mil whitehousecommsagency.mil whiteman.af.mil whiteman.tricare.mil whs.mil wilfordhall.tricare.mil william-beaumont.tricare.mil winn.tricare.mil womack.tricare.mil workfamilymonth.ors.nih.gov woundedwarrior.af.mil woundedwarrior.marines.mil wpafb.af.mil wrair.health.mil wrightpatterson.tricare.mil wv.ng.mil ww3.safaq.hq.af.mil yokosuka.tricare.mil yokota.af.mil yokota.tricare.mil youngstown.afrc.af.mil

gbinal commented 5 months ago

we figured this out a week or so ago and the new workflow for the index creation process should resolve it.