search

RedisLabs / spark-redis

A connector for Spark that allows reading and writing to/from Redis cluster
BSD 3-Clause "New" or "Revised" License
936 stars 367 forks source link

Do you consider supporting Spark to directly read and parse Redis RDB files as key value pairs? #363

Closed youngxinler closed 1 year ago

youngxinler commented 1 year ago

Direct reading of online databases for full database analysis may have an impact on online services, but direct reading of RDB files will not.

It can even further support Spark to produce RDB files. Writing KV files to Redis through RDB files is faster and more efficient.

sazzad16 commented 1 year ago

Directly reading/parsing Redis RDB files are not going to be suppoted, at least in recent future.