apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
https://seatunnel.apache.org/
Apache License 2.0
7.81k stars 1.76k forks source link

[Bug] [java.lang.AbstractMethodError] org.apache.thrift.transport.TTransport.checkReadBytesAvailable(J)V #7105

Open laixueyong opened 2 months ago

laixueyong commented 2 months ago

Search before asking

What happened

seatunnel读取hive时报错 Snipaste_2024-07-04_14-34-34

SeaTunnel Version

seatunnel版本2.3.5 cdh的hive为2.1.1 cdh的hadoop为3.0.0

SeaTunnel Config

env {
  job.mode = "BATCH"
}

source {

 Hive {
    table_name = "acrdb.bi_bi097t2"
    metastore_uri = "thrift://cdhtest05:9083"
    krb5_path = "/etc/krb5.conf"
    kerberos_keytab_path = "/home/extimp/hjx_work/flink-1.14.4/conf/hive.keytab"
    kerberos_principal = "hive/cdhtest02@PEC.COM.CN"
    hdfs_site_path = "/opt/cloudera/parcels/CDH/etc/hive/conf.dist/hdfs-site.xml"
  }

}

transform {

}

sink {
   Console{

  }
}

Running Command

/home/extimp/lxy_work/apache-seatunnel-2.3.5/bin/start-seatunnel-flink-13-connector-v2.sh --config /home/extimp/lxy_work/apache-seatunnel-2.3.5/hive_job/hive_console.conf

Error Exception

java.lang.AbstractMethodError: org.apache.thrift.transport.TTransport.checkReadBytesAvailable(J)V

Zeta or Flink or Spark Version

flink版本为1.14

Java or Scala Version

java版本为cdh1.8 cdh的hive为2.1.1 cdh的hadoop为3.0.0

Screenshots

Snipaste_2024-07-04_14-34-34

Are you willing to submit PR?

Code of Conduct

laixueyong commented 2 months ago

将引擎换成seaTunnel自己的引擎 image 可以看到Hive已经连接成功了 image 不知道是哪个jar包冲突了

monte0220 commented 1 month ago

问题解决了吗?遇到同样的问题