search

RedisLabs / spark-redis

A connector for Spark that allows reading and writing to/from Redis cluster
BSD 3-Clause "New" or "Revised" License
936 stars 367 forks source link

RedisJSON support #348

Open ghost opened 2 years ago

ghost commented 2 years ago

When writing a dataframe with an array column, the value is saved as a string in the form of a "WrappedArray(x, y, z)". Since Redis supports nested data structures through RedisJSON, spark-redis could offer a way to store complex spark data structures.

root
 |-- my_array: array (nullable = true)
 |    |-- element: string (containsNull = true)
 |-- id: string (nullable = true)