search

usgin / nrrc-documents

Working documents for NRRC & issue tracker for the Drupal Site.
http://nrrc1.usgin.org/
1 stars 0 forks source link

Harvest from Federal Register URL #1

Open jessicagood opened 10 years ago

jessicagood commented 10 years ago

Currently auto-importing documents from http://www.federalregister.gov/api/v1/articles.csv?&conditions[near][location]=az but that only retrieves 20 items. Should a different url be used?

ccaudill commented 10 years ago

@lmusil Could you direct Jessica about the correct URL? Aren't you using it to ingest into the 'NRRC' catalog?

lmusil commented 10 years ago

Alrighty, This gets everything for 2014: http://www.federalregister.gov/api/v1/articles.csv?&conditions[publication_date][year]=2014&conditions[term]=Arizona&per_page=1000

Keyword/term: Arizona Year of Publication :2014 Max records: 1000 (1000 is the highest you can go)

jessicagood commented 10 years ago

Thanks Leah. I modified it slightly so as to not include the year (I want it to continue to auto-harvest recent notices once we get to 2015 and beyond). So I used http://www.federalregister.gov/api/v1/articles.csv?&conditions[term]=Arizona&per_page=2000. Looked like 2000 was the highest I could go which takes us back to 1994 - which may be overkill.

ccaudill commented 10 years ago

Lee is addressing the National Archives (via the White House when he's in DC in a few weeks) to try and see if they will standardize their catalog more and allow a feed of only one state (AZ) or particular keywords ... we really need to try and contact someone with the National Archives (Fed Reg) earlier - need to get leads on who to contact there.