AbsaOSS / spline-spark-agent

Spline agent for Apache Spark
https://absaoss.github.io/spline/
Apache License 2.0
185 stars 95 forks source link

Replace json4s by other json SerDe #675

Closed cerveada closed 1 year ago

cerveada commented 1 year ago

Since json4s seems to be causing compatibility issues between different versions of Spark and shading, it seems to be difficult (see #667) it is worth considering to replace it by different library.

Ideal features of the library would be:

Some candidates:

https://github.com/spray/spray-json no automapping

https://github.com/rallyhealth/weePickle no automapping

wajda commented 1 year ago

ef674f44290f4670da88e0037b694995b2dd3c4f - A quick attempt to replace a shaded Json4s with a shaded Jackson + Scala module