apache / polaris

Apache Polaris, the interoperable, open source catalog for Apache Iceberg
https://polaris.apache.org/
Apache License 2.0
1.17k stars 130 forks source link

Move hadoop deps from core to `polaris-service` #439

Closed dimas-b closed 2 weeks ago

dimas-b commented 2 weeks ago

Hadoop dependencies are not required in polaris-core, but WasbTranslatingFileIOFactory still needs them for Iceberg FileIO

How Has This Been Tested?

Gradle-based tests

eric-maynard commented 2 weeks ago

Looks like the missing dependency broke a regression test:

polaris-1  | java.lang.NoClassDefFoundError: org/apache/hadoop/shaded/com/ctc/wstx/io/InputBootstrapper
dimas-b commented 2 weeks ago

Thanks for the pointer @eric-maynard : I reworked this PR by moving the hadoop dependencies rather than removing them.