search

USStateDept / search

1 stars 0 forks source link

Time constraint checking for full scan of state.gov #560

Closed captjt closed 7 years ago

captjt commented 7 years ago

Tentative: to do night of 01-04-2017

captjt commented 7 years ago

First attempt took ~3:45 hours on 01-05.

Doing second attempt 01-06 to validate the timing/ingestion process.

captjt commented 7 years ago

Second attempt last week was successful and redid it again on the aws instance 01-07 and the elasticsearch server on aws has now indexed pages and is ready for demo.

The rest service is ready as well to take requests from http GET requests.