search

ericphanson / arxiv-search

Elasticsearch-backed rewrite of arxiv-sanity
MIT License
4 stars 1 forks source link

elasticsearch integration in AWS pipeline #4

Open ericphanson opened 6 years ago

ericphanson commented 6 years ago

doesn't work yet-- need

  1. wrapper gets a field ESfield as an input. Sets the field ESfield in elasticsearch to the output of the Lambda which it runs.
  2. The OAI harvester on AWS should update ES.
  3. We should have a function to scroll through ES and set fulltext and havethumb on the dynamodb table to have if ES says we have them.