Describe the bug
DocumentDB connector can't handle querying Document fields that nested. I defined a Glue Table for metadata and am trying to query a field in my DocumentDB collection that is several layers nested. I get the following error when trying to reference that field.
NOT_SUPPORTED: Unsupported Presto Type [row( array(row( varchar, varchar)), row( varchar, array(row( varchar, bigint, varchar, varchar)), double))] in Lambda Data Source
I think its having an issue when translating the types from the glue table schema and ending up with row type within a row.
This schema works when derived using Schema inference but not when using Glue table metadata.
To Reproduce
Steps to reproduce the behavior:
Deploy Athena DocumentDB Connector
Put data in DocumentDB Collection that is multiple layers deep.
Define explicit schema in Glue for connector to use.
Execute athena query that references field with nested levels like a where field is not null clause.
See error
Expected behavior
Data to be returned and no error
Screenshots / Exceptions / Errors
If applicable, add screenshots, exception stack traces, or error messages to help explain your problem. Stack traces for exceptions thrown by your Connector can be found in CloudWatch Logs under the 'aws/lambda/' log group.
Connector Details (please complete the following information):
Describe the bug DocumentDB connector can't handle querying Document fields that nested. I defined a Glue Table for metadata and am trying to query a field in my DocumentDB collection that is several layers nested. I get the following error when trying to reference that field.
NOT_SUPPORTED: Unsupported Presto Type [row( array(row( varchar, varchar)), row( varchar, array(row( varchar, bigint, varchar, varchar)), double))] in Lambda Data Source
I think its having an issue when translating the types from the glue table schema and ending up with row type within a row.
This schema works when derived using Schema inference but not when using Glue table metadata.
To Reproduce Steps to reproduce the behavior:
Expected behavior Data to be returned and no error
Screenshots / Exceptions / Errors If applicable, add screenshots, exception stack traces, or error messages to help explain your problem. Stack traces for exceptions thrown by your Connector can be found in CloudWatch Logs under the 'aws/lambda/' log group.
Connector Details (please complete the following information):
Additional context