Open matthewmturner opened 2 years ago
Might also want to specify the Serde(s) for json
-> Eg: CSV is "org.apache.hadoop.mapred.TextInputFormat", "org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat", "org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe",
https://docs.aws.amazon.com/athena/latest/ug/json-serde.html
-> https://github.com/datafusion-contrib/datafusion-catalogprovider-glue/compare/main...support-json
I have JSON tables in my glue catalog and I get the following error for those:
No support for: org.apache.hadoop.mapred.TextInputFormat, org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat