RedisLabs / spark-redis

A connector for Spark that allows reading and writing to/from Redis cluster
BSD 3-Clause "New" or "Revised" License
936 stars 367 forks source link

Python support for RDD #379

Open px1624 opened 9 months ago

px1624 commented 9 months ago

Hi all,

I'm new to spark-redis. I'm looking to write a DataFrame to Redis using Python with PySpark. I see that the RDD APIs (toRedisHASH, toRedisKV, etc.) provide exactly what I'm looking for, but Python support is currently limited to DataFrames only. Is there a plan to support these methods in Python, or should I be using Scala for these tasks? Thanks in advance.