cisagov / dotgov-data

Official list of .gov domains
https://get.gov/about/data/
Creative Commons Zero v1.0 Universal
182 stars 51 forks source link

Update gov.txt directly from zone #118

Closed h-m-f-t closed 4 months ago

h-m-f-t commented 8 months ago

In #107, we updated gov.txt (a copy of the zone file) each day from the version we publish each day to CZDS. Instead of pulling once daily from a copy, we should pull from our DNS provider, Cloudflare.

Acceptance criteria

Additional Context

It's recommended that you fork the dotgov-data repo for this work.

We intend to eventually poll more frequently than 24 hours since the provenance of the data is the real source. In this issue, the goal is to simply replace where we're sourcing.

PaulKuykendall commented 7 months ago

@h-m-f-t - in Fireside, we reviewed this and wanted your feedback on the actual priority on this item. It's fairly high in the backlog now.

h-m-f-t commented 7 months ago

It's true this isn't super urgent. However, one of my reasons for it being high in the backlog is that it is similar to the work recently done to archive the CZDS zone file and so it may be easy to pick up.

h-m-f-t commented 4 months ago

I lightly updated the issue to de-scope questions about multiple commits in a PR. (When we poll more frequently, we'll want to see individual daily commits but summarize the daily diff into one (perhaps this is a PR, though we don't want to approve a PR before merging).