Insuffficient ElasticSearch timeout causing builds to fail

DataBiosphere / dos-azul-lambda

Provides access to DSS azul-index in the Data Object Service schemas

https://dos.commons.ucsc-cgp.org

Apache License 2.0

2 stars 2 forks source link

Insuffficient ElasticSearch timeout causing builds to fail #118

Closed natanlao closed 5 years ago

natanlao commented 5 years ago

Requests to the ElasticSearch instance we use for testing are timing out - it appears that the instance is down.

┆Issue is synchronized with this JIRA Story ┆Project Name: dos-azul-lambda ┆Issue Number: DAL-74

natanlao commented 5 years ago

Upon inspection, it turns out the instance is still up - my new guess is that since the test instance is a t2.micro, we may just need to set a longer timeout...

natanlao commented 5 years ago

Further testing implies that this conclusion is correct. It makes sense, because:

Creating the indexes succeeds, but doing the bulk upload fails.
The issue appears to be stochastic.

A good solution would be to increase the timeout, but only for the provisioning scripts - the default value is ten seconds, which should be long enough for any lambda query (but maybe not for uploading the test data on a t2.micro).