shsenior
commented
7 years ago @ruiwanguk
There was a minor version change to one of the underlying open source libraries [http-aws-es] used in the solution to manage requests to the Amazon ElasticSearch cluster that introduces a break in the deployment. We are performing regression testing today on the fix and should have an updated solution stack released tomorrow.
@shsenior thank you very much for updating the source code.
Following the new update, we tried to deploy the data lake using our own S3 bucket as the artifact repo.
Currently, we are getting some strange errors when initializing elastic search index for the first time. Any suggestions would be much appreciated.
Here is the section where cloudformation template failed:
`
DataLakeSearchIndex: DependsOn: "DataLakeWebsite" Type: "Custom::LoadLambda" Properties: ServiceToken: Fn::GetAtt:
And the output log we get from Cloud Watch is:
` REPORT RequestId: ccad318c-6d16-11e7-840a-0bac46c1d377 Duration: 14223.29 ms Billed Duration: 14300 ms Memory Size: 256 MB Max Memory Used: 42 MB
START RequestId: d94fe778-6d16-11e7-866b-db0445fd4b93 Version: $LATEST 2017-07-20T06:44:16.242Z d94fe778-6d16-11e7-866b-db0445fd4b93 Received event: { "RequestType": "Create", "ServiceToken": "arn:aws:lambda:us-east-1:213684302576:function:data-lake-helper", "ResponseURL": "https://cloudformation-custom-resource-response-useast1.s3.amazonaws.com/arn%3Aaws%3Acloudformation%3Aus-east-1%3A213684302576%3Astack/CGR-Data-Store/30967630-6d14-11e7-aead-500c286f3262%7CDataLakeSearchIndex%7Cde56a193-5075-4286-8e73-a93bb70d5247?AWSAccessKeyId=AKIAJNXHFR7P7YGKLDPQ&Expires=1500540255&Signature=oupbZp2ws4Vl8zDdnudXtzJxinc%3D", "StackId": "arn:aws:cloudformation:us-east-1:213684302576:stack/CGR-Data-Store/30967630-6d14-11e7-aead-500c286f3262", "RequestId": "de56a193-5075-4286-8e73-a93bb70d5247", "LogicalResourceId": "DataLakeSearchIndex", "ResourceType": "Custom::LoadLambda", "ResourceProperties": { "ServiceToken": "arn:aws:lambda:us-east-1:213684302576:function:data-lake-helper", "customAction": "createSearchIndex", "clusterUrl": "https://search-data-lake-yp762xsz7qjxfnoe4ddm36pnu4.us-east-1.es.amazonaws.com:80", "Region": [ "us-east-1" ], "searchIndex": "data-lake" } }
Elasticsearch ERROR: 2017-07-20T06:44:17Z Error: Request error, retrying PUT https://search-data-lake-yp762xsz7qjxfnoe4ddm36pnu4.us-east-1.es.amazonaws.com:80/data-lake => write EPROTO 140676374841152:error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol:../deps/openssl/openssl/ssl/s23_clnt.c:794:
at Log.error (/var/task/node_modules/elasticsearch/src/lib/log.js:225:56) at checkRespForFailure (/var/task/node_modules/elasticsearch/src/lib/transport.js:258:18) at HttpAmazonESConnector. (/var/task/node_modules/http-aws-es/node6.js:77:11)
at ClientRequest.bound (/var/task/node_modules/elasticsearch/node_modules/lodash/dist/lodash.js:729:21)
at ClientRequest. (/var/task/node_modules/aws-sdk/lib/http/node.js:89:19)
at emitOne (events.js:101:20)
at ClientRequest.emit (events.js:188:7)
at TLSSocket.socketErrorListener (_http_client.js:309:9)
at emitOne (events.js:96:13)
at TLSSocket.emit (events.js:188:7)
Elasticsearch ERROR: 2017-07-20T06:44:17Z Error: Request error, retrying PUT https://search-data-lake-yp762xsz7qjxfnoe4ddm36pnu4.us-east-1.es.amazonaws.com:80/data-lake => write EPROTO 140676374841152:error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol:../deps/openssl/openssl/ssl/s23_clnt.c:794:
at Log.error (/var/task/node_modules/elasticsearch/src/lib/log.js:225:56) at checkRespForFailure (/var/task/node_modules/elasticsearch/src/lib/transport.js:258:18) at HttpAmazonESConnector. (/var/task/node_modules/http-aws-es/node6.js:77:11)
at ClientRequest.bound (/var/task/node_modules/elasticsearch/node_modules/lodash/dist/lodash.js:729:21)
at emitOne (events.js:101:20)
at ClientRequest.emit (events.js:188:7)
at TLSSocket.socketErrorListener (_http_client.js:309:9)
at emitOne (events.js:96:13)
at TLSSocket.emit (events.js:188:7)
at onwriteError (_stream_writable.js:346:10)
Elasticsearch WARNING: 2017-07-20T06:44:17Z Unable to revive connection: https://search-data-lake-yp762xsz7qjxfnoe4ddm36pnu4.us-east-1.es.amazonaws.com:80/
Elasticsearch WARNING: 2017-07-20T06:44:17Z Unable to revive connection: https://search-data-lake-yp762xsz7qjxfnoe4ddm36pnu4.us-east-1.es.amazonaws.com:80/ `