search

apache / carbondata

High performance data store solution
carbondata.apache.org
Apache License 2.0
1.43k stars 704 forks source link

tez will report an error #4172

Open study-day opened 3 years ago

study-day commented 3 years ago

Data can only be read through hive. If you use hive to write input, tez will report an error.

Caused by: java.lang.RuntimeException: Failed to load plan: hdfs://hadoop-node-1:8020/tmp/hive/hdfs/010e1336-6251-4157-9499-e15efce79293/hive_2021-07-07_16-38-01_759_6301054491957594370-1/40e54cbd-439d-4e35-979a-fdc38dfa680f/map.xml: org.apache.hive.com.esotericsoftware.kryo.KryoException: Unable to find class: org.apache.carbondata.hive.MapredCarbonInputFormat
nihal0107 commented 3 years ago

Hi, can you please provide the detailed query which you are trying to execute: Like either you are facing the issue at the time of creating table or insert query.

Although from your error message it seems some problem with replacing the carbon jars. But before coming to conclusion we first need to check the query. Please go through the documentation link https://github.com/apache/carbondata/blob/master/docs/hive-guide.md

Here you will find the details about replacing the jars and write support with hive. Please note that Only non-transactional tables are supported when created through hive.

study-day commented 3 years ago

I guess it has something to do with tez. But I don't know how to solve it, I switched to spark sql.

nihal0107 commented 3 years ago

If you are not sure about the issue then can you please close it.

study-day commented 3 years ago

hi ,thank you for your suggestion。 you can try it in the hive client (tez engine) the error will happen .