apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.16k stars 855 forks source link

[Bug] NoSuchMethodError: org.apache.spark.sql.catalyst.trees.TreePattern$.SCALAR_SUBQUERY_REFERENCE #3275

Open pursuit-wangpz opened 2 months ago

pursuit-wangpz commented 2 months ago

Search before asking

Paimon version

0.7.0

Compute Engine

Spark 3.4.2

Minimal reproduce step

bin/spark-sql \ --conf spark.sql.catalog.spark_catalog=org.apache.paimon.spark.SparkGenericCatalog \ --conf spark.sql.extensions=org.apache.paimon.spark.extensions.PaimonSparkSessionExtensions \ --jars paimon-spark-3.4-0.7.0-incubating.jar

show tables; image

Tips: This Operation is normal on Spark 3.2.2

What doesn't meet your expectations?

can show tables

Anything else?

No response

Are you willing to submit a PR?

Zouxxyy commented 2 months ago

Can you try with the latest 0.8 snapshot