Cannot create RDDs in notebooks

Kotlin / kotlin-spark-api

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

Apache License 2.0

455 stars 34 forks source link

Cannot create RDDs in notebooks #215

Closed Jolanrensen closed 8 months ago

Jolanrensen commented 8 months ago

No matter whether I use scala=2.12 or scala=2.13, I get:

java.lang.ExceptionInInitializerError
...
Caused by: com.fasterxml.jackson.databind.JsonMappingException: Scala module 2.13.4 requires Jackson Databind version >= 2.13.0 and < 2.14.0 - Found jackson-databind version 2.14.2

when running listOf(1, 2, 3).toRDD(). toDF() seems to work fine.

Jolanrensen commented 8 months ago

Might have been a project library, turning off all fasterxml libraries in "Select project libraries to use in notebook classpath" solves the issue.