LEGACY_PASS_PARTITION_BY_AS_OPTIONS at save dataframe to hbase (spark 2.4.4 )

hortonworks-spark / shc

The Apache Spark - Apache HBase Connector is a library to support Spark accessing HBase table as external data source or sink.

Apache License 2.0

552 stars 281 forks source link

LEGACY_PASS_PARTITION_BY_AS_OPTIONS at save dataframe to hbase (spark 2.4.4 ) #325

Open AsmaZgo opened 4 years ago

AsmaZgo commented 4 years ago

in thread "main" java.lang.NoSuchMethodError: org.apache.spark.sql.internal.SQLConf$.LEGACY_PASS_PARTITION_BY_AS_OPTIONS()Lorg/apache/spark/internal/config/ConfigEntry; at org.apache.spark.sql.DataFrameWriter.saveToV1Source(DataFrameWriter.scala:277) at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:271)