search

r-three / common-pile

Repo to hold code and track issues for the collection of permissively licensed data
MIT License
22 stars 6 forks source link

USGPO #70

Open nkandpa2 opened 5 months ago

nkandpa2 commented 5 months ago

This PR uses the USGPO developer API to collect documents published by the USGPO. This will close #64.

StellaAthena commented 5 months ago

What is still "WIP" about this? What do we need to add so it's ready to go?

nkandpa2 commented 4 months ago

This PR should be ready to go. I've started a run going back to 1990. So far about 70K document links have been collected with at least a handful of documents coming from each year and no failures.