apache / iceberg

Apache Iceberg
https://iceberg.apache.org/
Apache License 2.0
6.49k stars 2.24k forks source link

Spark 3.5: Fix flaky TestRemoveOrphanFilesAction3 #11616

Closed manuzhang closed 14 hours ago

manuzhang commented 22 hours ago

Fix flaky tests in TestRemoveOrphanFilesAction3 as shown by https://github.com/apache/iceberg/actions/runs/11947170518/job/33302718931?pr=11612

 TestRemoveOrphanFilesAction3 > testSparkSessionCatalogHadoopTable() > formatVersion = 3 FAILED
    org.apache.spark.sql.catalyst.analysis.TableAlreadyExistsException: [TABLE_OR_VIEW_ALREADY_EXISTS] Cannot create table or view default.table680 because it already exists.
    Choose a different name, drop or replace the existing object, or add the IF NOT EXISTS clause to tolerate pre-existing objects.
        at app//org.apache.iceberg.spark.SparkCatalog.createTable(SparkCatalog.java:250)
        at app//org.apache.iceberg.spark.SparkSessionCatalog.createTable(SparkSessionCatalog.java:177)
        at app//org.apache.iceberg.spark.actions.TestRemoveOrphanFilesAction3.testSparkSessionCatalogHadoopTable(TestRemoveOrphanFilesAction3.java:138)

cc @nastra