search

hashicorp / nomad-spark

DEPRECATED: Apache Spark with native support for Nomad as a scheduler
44 stars 16 forks source link

[error] jackson-databind lib must be added manually #3

Open ryanmickler opened 6 years ago

ryanmickler commented 6 years ago

When i try to use the hashicorp/spark-nomad docker image (i.e. when i use cluster mode), i'm getting the following error 

Exception in thread "dispatcher-event-loop-0" java.lang.NoSuchFieldError: UPPER_CAMEL_CASE
    at com.hashicorp.nomad.javasdk.NomadJson.<clinit>(NomadJson.java:26)
...
Exception in thread "main" java.lang.NoClassDefFoundError: Could not initialize class com.hashicorp.nomad.javasdk.NomadJson
    at com.hashicorp.nomad.javasdk.AllocationsApi.info(AllocationsApi.java:46)

These errors don't appear when I run directly on my spark distro (non-cluster mode). Could this be caused by a version mismatch?

full stack trace - https://pastebin.com/eDPxqNtc

ryanmickler commented 6 years ago

So i discovered that this was due to not having the com.fasterxml.jackson.core - jackson-databind library installed on the container. If i include this in with my deployed app then it works. Perhaps we should include this by default?

Added "com.fasterxml.jackson.core" % "jackson-databind" % "2.7.9" to build.sbt