Closed arahuja closed 8 years ago
heh, just did this locally as well.
Seems like it being present as a test dep was enough to omit it from being picked up as a trans-dep by all dependencies (including Spark, which needs it), but then it doesn't make it into the packaged JAR because it's only a test dep.
Feels like broken decisions in the Maven stack, but yea lgtm
At some point,
commons-io
was moved to a test-only dependency, but this is necessary as a dependency when running withoutspark-submit
for Hadoop output.This change is