I have a below issue, so my friends suggest to resister the class explicitly.
"past 2 days, I’ve been running the same Hive queries. ~80% of the time they
fail with this KyroException, thrown from the Hive code. 20% of the time the
same job, runs successfully. No code differences between runs.
Yesterday, this same Hive Query failed with the KyroException all afternoon.
Then around 8:00 PM at night it ran fine. This morning (4/23), I ran the same
code again, processing 2 rows of data, and the job failed."
Below are the logs :
2015-04-23 10:35:57,893 INFO [main] org.apache.hadoop.hive.ql.exec.Utilities:
Deserializing MapWork via kryo
2015-04-23 10:35:58,290 ERROR [main] org.apache.hadoop.hive.ql.exec.Utilities:
Failed to load plan:
hdfs://nameservice1/tmp/hive-dks0344135/hive_2015-04-23_10-34-25_211_23338155210
43174815-4/-mr-10016/b7fe67d9-5471-4e66-bdf4-6280f840f5ec/map.xml
org.apache.hive.com.esotericsoftware.kryo.KryoException: Encountered
unregistered class ID: -848874534
Serialization trace:
startTimes (org.apache.hadoop.hive.ql.log.PerfLogger)
perfLogger (org.apache.hadoop.hive.ql.exec.MapJoinOperator)
parentOperators (org.apache.hadoop.hive.ql.exec.SelectOperator)
parentOperators (org.apache.hadoop.hive.ql.exec.MapJoinOperator)
parentOperators (org.apache.hadoop.hive.ql.exec.FilterOperator)
parentOperators (org.apache.hadoop.hive.ql.exec.SelectOperator)
parentOperators (org.apache.hadoop.hive.ql.exec.UnionOperator)
childOperators (org.apache.hadoop.hive.ql.exec.TableScanOperator)
aliasToWork (org.apache.hadoop.hive.ql.plan.MapWork)
at
org.apache.hive.com.esotericsoftware.kryo.util.DefaultClassResolver.readClass(De
faultClassResolver.java:119)
Please help me on this.
Original issue reported on code.google.com by ak3...@gmail.com on 23 Apr 2015 at 5:01
Original issue reported on code.google.com by
ak3...@gmail.com
on 23 Apr 2015 at 5:01