JaneliaSciComp / BigStitcher-Spark

Running compute-intense parts of BigStitcher distributed
BSD 2-Clause "Simplified" License
18 stars 10 forks source link

Upgrade to Spark-3.3.2. #17

Closed kgabor closed 9 months ago

kgabor commented 1 year ago

@trautmane The fatjar creation complained about the duplication of the following meta files. As far as I understand the first two items come from the different java version kotlin modules which may not be the used at the same time. I'm unsure about the jackson one. Is it OK to simply exclude these from the fatjar ?

<exclude>META-INF/versions/9/module-info.class</exclude>
<exclude>META-INF/okio.kotlin_module</exclude>
<exclude>META-INF/services/com.fasterxml.jackson.core.JsonFactory</exclude>
kgabor commented 10 months ago
kgabor commented 10 months ago

@tpietzsch I'll check the pom details with @trautmane . Then I think this should be ready for merging and it should be done before things start diverging again.