search

mjakubowski84 / parquet4s

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.
https://mjakubowski84.github.io/parquet4s/
MIT License
283 stars 65 forks source link

ERROR exec.DDLTask: Failed org.apache.hadoop.hive.ql.metadata.HiveException: com.google.common.util.concurrent.UncheckedExecutionException: com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$DecodingException: Failed to decode field metaData of record: RowParquetRecord #237

Closed hanna-liashchuk closed 2 years ago

hanna-liashchuk commented 2 years ago

Hi :)

I have a jar that reads data from jdbc and writes it in delta format to hdfs. Then, using scala.sys.process, I'm trying to create a table in Hive on top of that delta And I'm getting next error:

2021-12-01 17:02:33,322 ERROR exec.DDLTask: Failed org.apache.hadoop.hive.ql.metadata.HiveException: com.google.common.util.concurrent.UncheckedExecutionException: com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$DecodingException: Failed to decode field metaData of record: RowParquetRecord (metaData=RowParquetRecord (id=BinaryValue(Binary{36 constant bytes, [56, 98, 49, 97, 56, 97, 56, 50, 45, 97, 54, 102, 51, 45, 52, 55, 48, 56, 45, 57, 101, 102, 97, 45, 52, 55, 51, 51, 99, 56, 102, 102, 51, 52, 51, 53]}),format=RowParquetRecord (provider=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 113, 117, 101, 116]}),options=MapParquetRecord ()),schemaString=BinaryValue(Binary{708 constant bytes, [123, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 117, 99, 116, 34, 44, 34, 102, 105, 101, 108, 100, 115, 34, 58, 91, 123, 34, 110, 97, 109, 101, 34, 58, 34, 70, 73, 76, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 72, 69, 81, 85, 69, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 82, 69, 65, 84, 69, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 116, 105, 109, 101, 115, 116, 97, 109, 112, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 84, 89, 80, 69, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 108, 111, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 80, 69, 82, 67, 69, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 51, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 79, 85, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 50, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 99, 114, 101, 97, 116, 101, 100, 68, 97, 116, 101, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 86, 65, 82, 67, 72, 65, 82, 68, 65, 84, 65, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 112, 97, 114, 116, 95, 100, 116, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 97, 116, 101, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 93, 125]}),partitionColumns=ListParquetRecord (RowParquetRecord (array=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 116, 95, 100, 116]}))),configuration=MapParquetRecord (),createdTime=LongValue(1638291590936))) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:932) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:937) at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:4954) at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:428) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:205) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2664) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2335) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2011) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1709) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1703) at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:157) at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:218) at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239) at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402) at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:335) at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:787) at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759) at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:323) at org.apache.hadoop.util.RunJar.main(RunJar.java:236) Caused by: com.google.common.util.concurrent.UncheckedExecutionException: com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$DecodingException: Failed to decode field metaData of record: RowParquetRecord (metaData=RowParquetRecord (id=BinaryValue(Binary{36 constant bytes, [56, 98, 49, 97, 56, 97, 56, 50, 45, 97, 54, 102, 51, 45, 52, 55, 48, 56, 45, 57, 101, 102, 97, 45, 52, 55, 51, 51, 99, 56, 102, 102, 51, 52, 51, 53]}),format=RowParquetRecord (provider=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 113, 117, 101, 116]}),options=MapParquetRecord ()),schemaString=BinaryValue(Binary{708 constant bytes, [123, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 117, 99, 116, 34, 44, 34, 102, 105, 101, 108, 100, 115, 34, 58, 91, 123, 34, 110, 97, 109, 101, 34, 58, 34, 70, 73, 76, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 72, 69, 81, 85, 69, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 82, 69, 65, 84, 69, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 116, 105, 109, 101, 115, 116, 97, 109, 112, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 84, 89, 80, 69, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 108, 111, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 80, 69, 82, 67, 69, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 51, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 79, 85, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 50, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 99, 114, 101, 97, 116, 101, 100, 68, 97, 116, 101, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 86, 65, 82, 67, 72, 65, 82, 68, 65, 84, 65, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 112, 97, 114, 116, 95, 100, 116, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 97, 116, 101, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 93, 125]}),partitionColumns=ListParquetRecord (RowParquetRecord (array=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 116, 95, 100, 116]}))),configuration=MapParquetRecord (),createdTime=LongValue(1638291590936))) at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2050) at com.google.common.cache.LocalCache.get(LocalCache.java:3952) at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4871) at io.delta.hive.DeltaHelper$.loadDeltaLatestSnapshot(DeltaHelper.scala:118) at io.delta.hive.DeltaStorageHandler.preCreateTable(DeltaStorageHandler.scala:191) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:832) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:822) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:212) at com.sun.proxy.$Proxy39.createTable(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient$SynchronizedHandler.invoke(HiveMetaStoreClient.java:2773) at com.sun.proxy.$Proxy39.createTable(Unknown Source) at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:921) ... 25 more

I'm confused cause my schema doesn't even have metaData column
This issue is not reproduced every time and unfortunately, I cannot say what causes it. The same job can finish ok N times, but on N+1 will fail and stay like that. Seems that data are getting corrupted 
Please help
mjakubowski84 commented 2 years ago

Hi!

1) It looks like that there's an issue with reading metaData column. I guess this is an internal column used by Delta - it is not a part of user-defined schema. 2) There should be last caused by in the stack trace that tells what exactly is the problem - I do no see this in what you shared here 3) I am not an author of delta's library. I know that they are using some very old version of Parquet4s (1.2.1) which may lack many bug fixes. Last version of 1.x series is 1.9.4 - I recommend to override the version and try again.

hanna-liashchuk commented 2 years ago

HI Marcin, thanks for quick reply! :) the last cause by is here

Caused by: scala.MatchError: RowParquetRecord (array=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 116, 95, 100, 116]})) (of class com.github.mjakubowski84.parquet4s.RowParquetRecord)
    at com.github.mjakubowski84.parquet4s.PrimitiveValueCodecs$$anon$1.decodeNonNull(ValueCodec.scala:105)
    at com.github.mjakubowski84.parquet4s.PrimitiveValueCodecs$$anon$1.decodeNonNull(ValueCodec.scala:103)
    at com.github.mjakubowski84.parquet4s.OptionalValueCodec.decode(ValueCodec.scala:88)
    at com.github.mjakubowski84.parquet4s.OptionalValueCodec.decode$(ValueCodec.scala:85)
    at com.github.mjakubowski84.parquet4s.PrimitiveValueCodecs$$anon$1.decode(ValueCodec.scala:103)
    at com.github.mjakubowski84.parquet4s.ComplexValueCodecs$$anon$15.$anonfun$decodeNonNull$2(ValueCodec.scala:324)
    at scala.Function2.$anonfun$curried$2(Function2.scala:44)
    at com.github.mjakubowski84.parquet4s.ComplexValueCodecs$$anon$15.$anonfun$decodeNonNull$1(ValueCodec.scala:324)
    at scala.collection.TraversableLike.$anonfun$map$1(TraversableLike.scala:237)
    at scala.collection.Iterator.foreach(Iterator.scala:941)
    at scala.collection.Iterator.foreach$(Iterator.scala:941)
    at scala.collection.AbstractIterator.foreach(Iterator.scala:1429)
    at scala.collection.IterableLike.foreach(IterableLike.scala:74)
    at scala.collection.IterableLike.foreach$(IterableLike.scala:73)
    at com.github.mjakubowski84.parquet4s.ListParquetRecord.foreach(ParquetRecord.scala:219)
    at scala.collection.TraversableLike.map(TraversableLike.scala:237)
    at scala.collection.TraversableLike.map$(TraversableLike.scala:230)
    at com.github.mjakubowski84.parquet4s.ListParquetRecord.map(ParquetRecord.scala:219)
    at com.github.mjakubowski84.parquet4s.ComplexValueCodecs$$anon$15.decodeNonNull(ValueCodec.scala:324)
    at com.github.mjakubowski84.parquet4s.OptionalValueCodec.decode(ValueCodec.scala:88)
    at com.github.mjakubowski84.parquet4s.OptionalValueCodec.decode$(ValueCodec.scala:85)
    at com.github.mjakubowski84.parquet4s.ComplexValueCodecs$$anon$15.decode(ValueCodec.scala:320)
    at com.github.mjakubowski84.parquet4s.RowParquetRecord.get(ParquetRecord.scala:112)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:54)
    ... 93 more

I will check the delta lib too

hanna-liashchuk commented 2 years ago 
2021-12-01 17:02:33,322 ERROR exec.DDLTask: Failed
org.apache.hadoop.hive.ql.metadata.HiveException: com.google.common.util.concurrent.UncheckedExecutionException: com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$DecodingException: Failed to decode field metaData of record: RowParquetRecord (metaData=RowParquetRecord (id=BinaryValue(Binary{36 constant bytes, [56, 98, 49, 97, 56, 97, 56, 50, 45, 97, 54, 102, 51, 45, 52, 55, 48, 56, 45, 57, 101, 102, 97, 45, 52, 55, 51, 51, 99, 56, 102, 102, 51, 52, 51, 53]}),format=RowParquetRecord (provider=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 113, 117, 101, 116]}),options=MapParquetRecord ()),schemaString=BinaryValue(Binary{708 constant bytes, [123, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 117, 99, 116, 34, 44, 34, 102, 105, 101, 108, 100, 115, 34, 58, 91, 123, 34, 110, 97, 109, 101, 34, 58, 34, 70, 73, 76, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 72, 69, 81, 85, 69, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 82, 69, 65, 84, 69, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 116, 105, 109, 101, 115, 116, 97, 109, 112, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 84, 89, 80, 69, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 108, 111, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 80, 69, 82, 67, 69, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 51, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 79, 85, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 50, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 99, 114, 101, 97, 116, 101, 100, 68, 97, 116, 101, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 86, 65, 82, 67, 72, 65, 82, 68, 65, 84, 65, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 112, 97, 114, 116, 95, 100, 116, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 97, 116, 101, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 93, 125]}),partitionColumns=ListParquetRecord (RowParquetRecord (array=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 116, 95, 100, 116]}))),configuration=MapParquetRecord (),createdTime=LongValue(1638291590936)))
    at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:932)
    at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:937)
    at org.apache.hadoop.hive.ql.exec.DDLTask.createTable(DDLTask.java:4954)
    at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:428)
    at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:205)
    at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97)
    at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2664)
    at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2335)
    at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2011)
    at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1709)
    at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1703)
    at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:157)
    at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:218)
    at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239)
    at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188)
    at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402)
    at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:335)
    at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:787)
    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
Caused by: com.google.common.util.concurrent.UncheckedExecutionException: com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$DecodingException: Failed to decode field metaData of record: RowParquetRecord (metaData=RowParquetRecord (id=BinaryValue(Binary{36 constant bytes, [56, 98, 49, 97, 56, 97, 56, 50, 45, 97, 54, 102, 51, 45, 52, 55, 48, 56, 45, 57, 101, 102, 97, 45, 52, 55, 51, 51, 99, 56, 102, 102, 51, 52, 51, 53]}),format=RowParquetRecord (provider=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 113, 117, 101, 116]}),options=MapParquetRecord ()),schemaString=BinaryValue(Binary{708 constant bytes, [123, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 117, 99, 116, 34, 44, 34, 102, 105, 101, 108, 100, 115, 34, 58, 91, 123, 34, 110, 97, 109, 101, 34, 58, 34, 70, 73, 76, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 72, 69, 81, 85, 69, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 82, 69, 65, 84, 69, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 116, 105, 109, 101, 115, 116, 97, 109, 112, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 84, 89, 80, 69, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 108, 111, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 80, 69, 82, 67, 69, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 51, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 79, 85, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 50, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 99, 114, 101, 97, 116, 101, 100, 68, 97, 116, 101, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 86, 65, 82, 67, 72, 65, 82, 68, 65, 84, 65, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 112, 97, 114, 116, 95, 100, 116, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 97, 116, 101, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 93, 125]}),partitionColumns=ListParquetRecord (RowParquetRecord (array=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 116, 95, 100, 116]}))),configuration=MapParquetRecord (),createdTime=LongValue(1638291590936)))
    at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2050)
    at com.google.common.cache.LocalCache.get(LocalCache.java:3952)
    at com.google.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4871)
    at io.delta.hive.DeltaHelper$.loadDeltaLatestSnapshot(DeltaHelper.scala:118)
    at io.delta.hive.DeltaStorageHandler.preCreateTable(DeltaStorageHandler.scala:191)
    at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:832)
    at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.createTable(HiveMetaStoreClient.java:822)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:212)
    at com.sun.proxy.$Proxy39.createTable(Unknown Source)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.hadoop.hive.metastore.HiveMetaStoreClient$SynchronizedHandler.invoke(HiveMetaStoreClient.java:2773)
    at com.sun.proxy.$Proxy39.createTable(Unknown Source)
    at org.apache.hadoop.hive.ql.metadata.Hive.createTable(Hive.java:921)
    ... 25 more
Caused by: com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$DecodingException: Failed to decode field metaData of record: RowParquetRecord (metaData=RowParquetRecord (id=BinaryValue(Binary{36 constant bytes, [56, 98, 49, 97, 56, 97, 56, 50, 45, 97, 54, 102, 51, 45, 52, 55, 48, 56, 45, 57, 101, 102, 97, 45, 52, 55, 51, 51, 99, 56, 102, 102, 51, 52, 51, 53]}),format=RowParquetRecord (provider=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 113, 117, 101, 116]}),options=MapParquetRecord ()),schemaString=BinaryValue(Binary{708 constant bytes, [123, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 117, 99, 116, 34, 44, 34, 102, 105, 101, 108, 100, 115, 34, 58, 91, 123, 34, 110, 97, 109, 101, 34, 58, 34, 70, 73, 76, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 72, 69, 81, 85, 69, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 82, 69, 65, 84, 69, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 116, 105, 109, 101, 115, 116, 97, 109, 112, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 84, 89, 80, 69, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 108, 111, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 80, 69, 82, 67, 69, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 51, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 79, 85, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 50, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 99, 114, 101, 97, 116, 101, 100, 68, 97, 116, 101, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 86, 65, 82, 67, 72, 65, 82, 68, 65, 84, 65, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 112, 97, 114, 116, 95, 100, 116, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 97, 116, 101, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 93, 125]}),partitionColumns=ListParquetRecord (RowParquetRecord (array=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 116, 95, 100, 116]}))),configuration=MapParquetRecord (),createdTime=LongValue(1638291590936)))
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$DecodingException$.apply(ParquetRecordDecoder.scala:28)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:57)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:50)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:59)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:50)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:59)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:50)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:59)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:50)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$3.decode(ParquetRecordDecoder.scala:69)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$.decode(ParquetRecordDecoder.scala:39)
    at com.github.mjakubowski84.parquet4s.ParquetIterableImpl$$anon$2.$anonfun$hasNext$2(ParquetReader.scala:113)
    at scala.Function2.$anonfun$curried$2(Function2.scala:44)
    at com.github.mjakubowski84.parquet4s.ParquetIterableImpl$$anon$2.$anonfun$hasNext$1(ParquetReader.scala:113)
    at scala.Option.map(Option.scala:163)
    at com.github.mjakubowski84.parquet4s.ParquetIterableImpl$$anon$2.hasNext(ParquetReader.scala:113)
    at scala.collection.Iterator.toStream(Iterator.scala:1415)
    at scala.collection.Iterator.toStream$(Iterator.scala:1414)
    at com.github.mjakubowski84.parquet4s.ParquetIterableImpl$$anon$2.toStream(ParquetReader.scala:100)
    at scala.collection.Iterator.$anonfun$toStream$1(Iterator.scala:1415)
    at scala.collection.immutable.Stream$Cons.tail(Stream.scala:1171)
    at scala.collection.immutable.Stream$Cons.tail(Stream.scala:1161)
    at scala.collection.immutable.Stream.$anonfun$map$1(Stream.scala:418)
    at scala.collection.immutable.Stream$Cons.tail(Stream.scala:1171)
    at scala.collection.immutable.Stream$Cons.tail(Stream.scala:1161)
    at scala.collection.immutable.StreamIterator.$anonfun$next$1(Stream.scala:1061)
    at scala.collection.immutable.StreamIterator$LazyCell.v$lzycompute(Stream.scala:1050)
    at scala.collection.immutable.StreamIterator$LazyCell.v(Stream.scala:1050)
    at scala.collection.immutable.StreamIterator.hasNext(Stream.scala:1055)
    at scala.collection.Iterator.foreach(Iterator.scala:941)
    at scala.collection.Iterator.foreach$(Iterator.scala:941)
    at scala.collection.AbstractIterator.foreach(Iterator.scala:1429)
    at scala.collection.generic.Growable.$plus$plus$eq(Growable.scala:62)
    at scala.collection.generic.Growable.$plus$plus$eq$(Growable.scala:53)
    at scala.collection.parallel.mutable.ResizableParArrayCombiner$$anon$1.$plus$plus$eq(ResizableParArrayCombiner.scala:87)
    at scala.collection.parallel.mutable.ParArray$ParArrayIterator.flatmap2combiner(ParArray.scala:420)
    at scala.collection.parallel.ParIterableLike$FlatMap.leaf(ParIterableLike.scala:1074)
    at scala.collection.parallel.Task.$anonfun$tryLeaf$1(Tasks.scala:53)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at scala.util.control.Breaks$$anon$1.catchBreak(Breaks.scala:67)
    at scala.collection.parallel.Task.tryLeaf(Tasks.scala:56)
    at scala.collection.parallel.Task.tryLeaf$(Tasks.scala:50)
    at scala.collection.parallel.ParIterableLike$FlatMap.tryLeaf(ParIterableLike.scala:1070)
    at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask.internal(Tasks.scala:160)
    at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask.internal$(Tasks.scala:157)
    at scala.collection.parallel.AdaptiveWorkStealingForkJoinTasks$WrappedTask.internal(Tasks.scala:440)
    at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask.compute(Tasks.scala:150)
    at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask.compute$(Tasks.scala:149)
    at scala.collection.parallel.AdaptiveWorkStealingForkJoinTasks$WrappedTask.compute(Tasks.scala:440)
    at java.util.concurrent.RecursiveAction.exec(RecursiveAction.java:189)
    at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
    at java.util.concurrent.ForkJoinTask.doJoin(ForkJoinTask.java:389)
    at java.util.concurrent.ForkJoinTask.join(ForkJoinTask.java:719)
    at scala.collection.parallel.ForkJoinTasks$WrappedTask.sync(Tasks.scala:379)
    at scala.collection.parallel.ForkJoinTasks$WrappedTask.sync$(Tasks.scala:379)
    at scala.collection.parallel.AdaptiveWorkStealingForkJoinTasks$WrappedTask.sync(Tasks.scala:440)
    at scala.collection.parallel.ForkJoinTasks.executeAndWaitResult(Tasks.scala:423)
    at scala.collection.parallel.ForkJoinTasks.executeAndWaitResult$(Tasks.scala:416)
    at scala.collection.parallel.ForkJoinTaskSupport.executeAndWaitResult(TaskSupport.scala:60)
    at scala.collection.parallel.ExecutionContextTasks.executeAndWaitResult(Tasks.scala:555)
    at scala.collection.parallel.ExecutionContextTasks.executeAndWaitResult$(Tasks.scala:555)
    at scala.collection.parallel.ExecutionContextTaskSupport.executeAndWaitResult(TaskSupport.scala:84)
    at scala.collection.parallel.ParIterableLike$ResultMapping.leaf(ParIterableLike.scala:960)
    at scala.collection.parallel.Task.$anonfun$tryLeaf$1(Tasks.scala:53)
    at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23)
    at scala.util.control.Breaks$$anon$1.catchBreak(Breaks.scala:67)
    at scala.collection.parallel.Task.tryLeaf(Tasks.scala:56)
    at scala.collection.parallel.Task.tryLeaf$(Tasks.scala:50)
    at scala.collection.parallel.ParIterableLike$ResultMapping.tryLeaf(ParIterableLike.scala:955)
    at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask.compute(Tasks.scala:153)
    at scala.collection.parallel.AdaptiveWorkStealingTasks$WrappedTask.compute$(Tasks.scala:149)
    at scala.collection.parallel.AdaptiveWorkStealingForkJoinTasks$WrappedTask.compute(Tasks.scala:440)
    at java.util.concurrent.RecursiveAction.exec(RecursiveAction.java:189)
    at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
    at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
    at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
    at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
Caused by: com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$DecodingException: Failed to decode field partitionColumns of record: RowParquetRecord (id=BinaryValue(Binary{36 constant bytes, [56, 98, 49, 97, 56, 97, 56, 50, 45, 97, 54, 102, 51, 45, 52, 55, 48, 56, 45, 57, 101, 102, 97, 45, 52, 55, 51, 51, 99, 56, 102, 102, 51, 52, 51, 53]}),format=RowParquetRecord (provider=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 113, 117, 101, 116]}),options=MapParquetRecord ()),schemaString=BinaryValue(Binary{708 constant bytes, [123, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 117, 99, 116, 34, 44, 34, 102, 105, 101, 108, 100, 115, 34, 58, 91, 123, 34, 110, 97, 109, 101, 34, 58, 34, 70, 73, 76, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 72, 69, 81, 85, 69, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 82, 69, 65, 84, 69, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 116, 105, 109, 101, 115, 116, 97, 109, 112, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 84, 89, 80, 69, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 108, 111, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 80, 69, 82, 67, 69, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 51, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 79, 85, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 50, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 99, 114, 101, 97, 116, 101, 100, 68, 97, 116, 101, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 86, 65, 82, 67, 72, 65, 82, 68, 65, 84, 65, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 112, 97, 114, 116, 95, 100, 116, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 97, 116, 101, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 93, 125]}),partitionColumns=ListParquetRecord (RowParquetRecord (array=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 116, 95, 100, 116]}))),configuration=MapParquetRecord (),createdTime=LongValue(1638291590936))
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$DecodingException$.apply(ParquetRecordDecoder.scala:28)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:57)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:50)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:59)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:50)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:59)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:50)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:59)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:50)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:59)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:50)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:59)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:50)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$3.decode(ParquetRecordDecoder.scala:69)
    at com.github.mjakubowski84.parquet4s.ComplexValueCodecs$$anon$19.decodeNonNull(ValueCodec.scala:403)
    at com.github.mjakubowski84.parquet4s.OptionalValueCodec.decode(ValueCodec.scala:88)
    at com.github.mjakubowski84.parquet4s.OptionalValueCodec.decode$(ValueCodec.scala:85)
    at com.github.mjakubowski84.parquet4s.ComplexValueCodecs$$anon$19.decode(ValueCodec.scala:398)
    at com.github.mjakubowski84.parquet4s.RowParquetRecord.get(ParquetRecord.scala:112)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:54)
    ... 75 more
Caused by: scala.MatchError: RowParquetRecord (array=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 116, 95, 100, 116]})) (of class com.github.mjakubowski84.parquet4s.RowParquetRecord)
    at com.github.mjakubowski84.parquet4s.PrimitiveValueCodecs$$anon$1.decodeNonNull(ValueCodec.scala:105)
    at com.github.mjakubowski84.parquet4s.PrimitiveValueCodecs$$anon$1.decodeNonNull(ValueCodec.scala:103)
    at com.github.mjakubowski84.parquet4s.OptionalValueCodec.decode(ValueCodec.scala:88)
    at com.github.mjakubowski84.parquet4s.OptionalValueCodec.decode$(ValueCodec.scala:85)
    at com.github.mjakubowski84.parquet4s.PrimitiveValueCodecs$$anon$1.decode(ValueCodec.scala:103)
    at com.github.mjakubowski84.parquet4s.ComplexValueCodecs$$anon$15.$anonfun$decodeNonNull$2(ValueCodec.scala:324)
    at scala.Function2.$anonfun$curried$2(Function2.scala:44)
    at com.github.mjakubowski84.parquet4s.ComplexValueCodecs$$anon$15.$anonfun$decodeNonNull$1(ValueCodec.scala:324)
    at scala.collection.TraversableLike.$anonfun$map$1(TraversableLike.scala:237)
    at scala.collection.Iterator.foreach(Iterator.scala:941)
    at scala.collection.Iterator.foreach$(Iterator.scala:941)
    at scala.collection.AbstractIterator.foreach(Iterator.scala:1429)
    at scala.collection.IterableLike.foreach(IterableLike.scala:74)
    at scala.collection.IterableLike.foreach$(IterableLike.scala:73)
    at com.github.mjakubowski84.parquet4s.ListParquetRecord.foreach(ParquetRecord.scala:219)
    at scala.collection.TraversableLike.map(TraversableLike.scala:237)
    at scala.collection.TraversableLike.map$(TraversableLike.scala:230)
    at com.github.mjakubowski84.parquet4s.ListParquetRecord.map(ParquetRecord.scala:219)
    at com.github.mjakubowski84.parquet4s.ComplexValueCodecs$$anon$15.decodeNonNull(ValueCodec.scala:324)
    at com.github.mjakubowski84.parquet4s.OptionalValueCodec.decode(ValueCodec.scala:88)
    at com.github.mjakubowski84.parquet4s.OptionalValueCodec.decode$(ValueCodec.scala:85)
    at com.github.mjakubowski84.parquet4s.ComplexValueCodecs$$anon$15.decode(ValueCodec.scala:320)
    at com.github.mjakubowski84.parquet4s.RowParquetRecord.get(ParquetRecord.scala:112)
    at com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$$anon$2.decode(ParquetRecordDecoder.scala:54)
    ... 93 more
2021-12-01 17:02:33,326 INFO reexec.ReOptimizePlugin: ReOptimization: retryPossible: false
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. com.google.common.util.concurrent.UncheckedExecutionException: com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$DecodingException: Failed to decode field metaData of record: RowParquetRecord (metaData=RowParquetRecord (id=BinaryValue(Binary{36 constant bytes, [56, 98, 49, 97, 56, 97, 56, 50, 45, 97, 54, 102, 51, 45, 52, 55, 48, 56, 45, 57, 101, 102, 97, 45, 52, 55, 51, 51, 99, 56, 102, 102, 51, 52, 51, 53]}),format=RowParquetRecord (provider=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 113, 117, 101, 116]}),options=MapParquetRecord ()),schemaString=BinaryValue(Binary{708 constant bytes, [123, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 117, 99, 116, 34, 44, 34, 102, 105, 101, 108, 100, 115, 34, 58, 91, 123, 34, 110, 97, 109, 101, 34, 58, 34, 70, 73, 76, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 72, 69, 81, 85, 69, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 82, 69, 65, 84, 69, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 116, 105, 109, 101, 115, 116, 97, 109, 112, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 84, 89, 80, 69, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 108, 111, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 80, 69, 82, 67, 69, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 51, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 79, 85, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 50, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 99, 114, 101, 97, 116, 101, 100, 68, 97, 116, 101, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 86, 65, 82, 67, 72, 65, 82, 68, 65, 84, 65, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 112, 97, 114, 116, 95, 100, 116, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 97, 116, 101, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 93, 125]}),partitionColumns=ListParquetRecord (RowParquetRecord (array=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 116, 95, 100, 116]}))),configuration=MapParquetRecord (),createdTime=LongValue(1638291590936)))
2021-12-01 17:02:33,326 ERROR ql.Driver: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. com.google.common.util.concurrent.UncheckedExecutionException: com.github.mjakubowski84.parquet4s.ParquetRecordDecoder$DecodingException: Failed to decode field metaData of record: RowParquetRecord (metaData=RowParquetRecord (id=BinaryValue(Binary{36 constant bytes, [56, 98, 49, 97, 56, 97, 56, 50, 45, 97, 54, 102, 51, 45, 52, 55, 48, 56, 45, 57, 101, 102, 97, 45, 52, 55, 51, 51, 99, 56, 102, 102, 51, 52, 51, 53]}),format=RowParquetRecord (provider=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 113, 117, 101, 116]}),options=MapParquetRecord ()),schemaString=BinaryValue(Binary{708 constant bytes, [123, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 117, 99, 116, 34, 44, 34, 102, 105, 101, 108, 100, 115, 34, 58, 91, 123, 34, 110, 97, 109, 101, 34, 58, 34, 70, 73, 76, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 72, 69, 81, 85, 69, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 67, 82, 69, 65, 84, 69, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 116, 105, 109, 101, 115, 116, 97, 109, 112, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 84, 89, 80, 69, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 105, 110, 116, 101, 103, 101, 114, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 65, 67, 84, 73, 79, 78, 73, 68, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 108, 111, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 80, 69, 82, 67, 69, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 51, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 68, 73, 83, 67, 79, 85, 78, 84, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 101, 99, 105, 109, 97, 108, 40, 57, 44, 50, 41, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 99, 114, 101, 97, 116, 101, 100, 68, 97, 116, 101, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 86, 65, 82, 67, 72, 65, 82, 68, 65, 84, 65, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 115, 116, 114, 105, 110, 103, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 44, 123, 34, 110, 97, 109, 101, 34, 58, 34, 112, 97, 114, 116, 95, 100, 116, 34, 44, 34, 116, 121, 112, 101, 34, 58, 34, 100, 97, 116, 101, 34, 44, 34, 110, 117, 108, 108, 97, 98, 108, 101, 34, 58, 116, 114, 117, 101, 44, 34, 109, 101, 116, 97, 100, 97, 116, 97, 34, 58, 123, 125, 125, 93, 125]}),partitionColumns=ListParquetRecord (RowParquetRecord (array=BinaryValue(Binary{7 constant bytes, [112, 97, 114, 116, 95, 100, 116]}))),configuration=MapParquetRecord (),createdTime=LongValue(1638291590936)))
2021-12-01 17:02:33,327 INFO ql.Driver: Completed executing command(queryId=j-palefat_20211201170227_724cf37f-3693-4858-8c77-488c963fed60); Time taken: 4.903 seconds
2021-12-01 17:02:33,327 INFO ql.Driver: Concurrency mode is disabled, not creating a lock manager
2021-12-01 17:02:33,345 INFO tez.DagUtils: Resource modification time: 1638370953332 for hdfs://hadoop-palefat/var/log/hive/j-palefat/_tez_session_dir/1b2e3198-e1bb-469e-bf04-00f0680f5d35-resources/jline-2.14.6.jar
2021-12-01 17:02:33,345 INFO tez.DagUtils: Localizing resource because it does not exist: file:/opt/spark/jars/joda-time-2.10.5.jar to dest: hdfs://hadoop-palefat/var/log/hive/j-palefat/_tez_session_dir/1b2e3198-e1bb-469e-bf04-00f0680f5d35-resources/joda-time-2.10.5.jar
2021-12-01 17:02:33,355 INFO conf.HiveConf: Using the default value passed in for log id: 4b123b4a-8a4c-4aa9-9558-41c1bc315a92
2021-12-01 17:02:33,356 INFO session.SessionState: Resetting thread name to  main
2021-12-01 17:02:33,356 INFO conf.HiveConf: Using the default value passed in for log id: 4b123b4a-8a4c-4aa9-9558-41c1bc315a92
2021-12-01 17:02:33,367 INFO tez.TezSessionPoolManager: Closing tez session if not default: sessionId=4b123b4a-8a4c-4aa9-9558-41c1bc315a92, queueName=null, user=j-palefat, doAs=true, isOpen=false, isDefault=false
2021-12-01 17:02:33,367 ERROR tez.TezSessionState: Failed to start Tez session
java.io.InterruptedIOException: Retry interrupted
    at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.processWaitTimeAndRetryInfo(RetryInvocationHandler.java:136)
    at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:107)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359)
    at com.sun.proxy.$Proxy42.getNewApplication(Unknown Source)
    at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getNewApplication(YarnClientImpl.java:257)
    at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.createApplication(YarnClientImpl.java:265)
    at org.apache.tez.client.TezYarnClient.createApplication(TezYarnClient.java:71)
    at org.apache.tez.client.TezClient.createApplication(TezClient.java:1145)
    at org.apache.tez.client.TezClient.start(TezClient.java:398)
    at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.startSessionAndContainers(TezSessionState.java:433)
    at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.access$100(TezSessionState.java:101)
    at org.apache.hadoop.hive.ql.exec.tez.TezSessionState$1.call(TezSessionState.java:376)
    at org.apache.hadoop.hive.ql.exec.tez.TezSessionState$1.call(TezSessionState.java:371)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.InterruptedException: sleep interrupted
    at java.lang.Thread.sleep(Native Method)
    at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.processWaitTimeAndRetryInfo(RetryInvocationHandler.java:130)
    ... 14 more
mjakubowski84 commented 2 years ago

https://github.com/mjakubowski84/parquet4s/blob/v1.2.1/core/src/main/scala/com/github/mjakubowski84/parquet4s/ValueCodec.scala#L105

So, the schema expected a binary (string) but the record arrived (complex object, seems to be an array).

mjakubowski84 commented 2 years ago

it looks like a bug in delta and/or data

hanna-liashchuk commented 2 years ago

Yeap, thanks, they've accepted it as a bug Have a nice day :)

mjakubowski84 commented 2 years ago

NP!