awslabs / aws-athena-query-federation

The Amazon Athena Query Federation SDK allows you to customize Amazon Athena with your own data sources and code.
Apache License 2.0
557 stars 293 forks source link

[BUG] Elasticsearch connector unable to list/query datastreams #511

Closed npow closed 1 year ago

npow commented 3 years ago

Describe the bug

  1. Show tables does not return any datastreams: show tables in `lambda:elasticsearch`.es
  2. When trying to query datastream directly, runtime exception is thrown: describe `lambda:elasticsearch`.es.pages

To Reproduce Steps to reproduce the behavior:

  1. run show tables on an ES instance with datastreams
  2. try to query the datastream directly

Expected behavior Expect datastreams to show up and behave like regular tables

Screenshots / Exceptions / Errors

java.lang.RuntimeException: com.amazonaws.services.lambda.invoke.LambdaFunctionException: Error processing request to map index (pages): null

Connector Details (please complete the following information):

Additional context Elasticsearch datastreams: https://www.elastic.co/guide/en/elasticsearch/reference/master/data-streams.html

chngpe commented 1 year ago

Hi,

We have added support for data stream on ES connectors, please use our latest version >=2023.18.1