search

oap-project / raydp

RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.
Apache License 2.0
293 stars 66 forks source link

[Follow-up] Fix log4j and some dependencies for `shims-common` #362

Closed Deegue closed 11 months ago

Deegue commented 11 months ago
  1. Exclude log4j:log4j in Spark 3.2.2
  2. Fix missed in shims-common
  3. Remove redirectLog() which is outdated
kira-lin commented 11 months ago

I think core/pom.xml also needs an update, right? All poms using spark version 3.2.2 needs the update @Deegue

Deegue commented 11 months ago

I think core/pom.xml also needs an update, right? All poms using spark version 3.2.2 needs the update @Deegue

Good catch! Added.