apache / amoro

Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.
https://amoro.apache.org/
Apache License 2.0
874 stars 290 forks source link

[hotfix] Paimon S3 File Reader Miss Pom dependency #3241

Closed czy006 closed 1 month ago

czy006 commented 1 month ago

Why are the changes needed?

2024-10-11 10:49:08,133 ERROR [main] [org.apache.amoro.server.AmoroServiceContainer] [] - AMS start error
java.io.UncheckedIOException: org.apache.paimon.fs.UnsupportedSchemeException: Could not find a file io implementation for scheme 's3' in the classpath.  Hadoop FileSystem also cannot access this path 's3://gzczy-test/warehouse'.
        at org.apache.paimon.catalog.CatalogFactory.createUnwrappedCatalog(CatalogFactory.java:100) ~[paimon-bundle-0.9.0.jar:0.9.0]
        at org.apache.paimon.catalog.CatalogFactory.createCatalog(CatalogFactory.java:71) ~[paimon-bundle-0.9.0.jar:0.9.0]
        at org.apache.paimon.catalog.CatalogFactory.createCatalog(CatalogFactory.java:67) ~[paimon-bundle-0.9.0.jar:0.9.0]
        at org.apache.amoro.formats.paimon.PaimonCatalogFactory.paimonCatalog(PaimonCatalogFactory.java:73) ~[amoro-format-paimon-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.formats.paimon.PaimonCatalogFactory.create(PaimonCatalogFactory.java:62) ~[amoro-format-paimon-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.formats.paimon.PaimonCatalogFactory.create(PaimonCatalogFactory.java:40) ~[amoro-format-paimon-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.CommonUnifiedCatalog.initializeFormatCatalogs(CommonUnifiedCatalog.java:226) ~[amoro-common-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.CommonUnifiedCatalog.<init>(CommonUnifiedCatalog.java:60) ~[amoro-common-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.server.catalog.ExternalCatalog.lambda$new$0(ExternalCatalog.java:52) ~[amoro-ams-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:268) ~[amoro-common-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:241) ~[amoro-common-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.server.catalog.ExternalCatalog.<init>(ExternalCatalog.java:51) ~[amoro-ams-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.server.catalog.CatalogBuilder.buildServerCatalog(CatalogBuilder.java:87) ~[amoro-ams-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.server.table.DefaultTableService.initServerCatalog(DefaultTableService.java:163) ~[amoro-ams-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at java.util.ArrayList.forEach(ArrayList.java:1257) ~[?:1.8.0_172]
        at org.apache.amoro.server.table.DefaultTableService.initialize(DefaultTableService.java:394) ~[amoro-ams-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.server.AmoroServiceContainer.startService(AmoroServiceContainer.java:159) ~[amoro-ams-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]
        at org.apache.amoro.server.AmoroServiceContainer.main(AmoroServiceContainer.java:117) [amoro-ams-0.8-SNAPSHOT.jar:0.8-SNAPSHOT]

Brief change log

How was this patch tested?

Documentation