search

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.16k stars 855 forks source link

[spark] Exclude orc-core from spark-core_2.12 dependency #3523

Closed Zouxxyy closed 1 month ago

Zouxxyy commented 1 month ago

Purpose

For test failure in IDEA

An exception or error caused a run to abort: COMPRESSION_ZSTD_LEVEL 
java.lang.NoSuchFieldError: COMPRESSION_ZSTD_LEVEL
    at org.apache.paimon.format.orc.OrcFileFormat.getOrcProperties(OrcFileFormat.java:153)
    at org.apache.paimon.format.orc.OrcFileFormat.<init>(OrcFileFormat.java:74)
    at org.apache.paimon.format.orc.OrcFileFormatFactory.create(OrcFileFormatFactory.java:35)
    at org.apache.paimon.format.orc.OrcFileFormatFactory.create(OrcFileFormatFactory.java:24)
    at org.apache.paimon.format.FileFormat.fromIdentifier(FileFormat.java:99)
    at org.apache.paimon.format.FileFormat.fromIdentifier(FileFormat.java:84)
    at org.apache.paimon.format.FileFormat.fromIdentifier(FileFormat.java:79)
    at org.apache.paimon.schema.SchemaValidation.validateTableSchema(SchemaValidation.java:142)
    at org.apache.paimon.schema.SchemaManager.commit(SchemaManager.java:475)

Tests

API and Format

Documentation