search

RedisLabs / spark-redis

A connector for Spark that allows reading and writing to/from Redis cluster
BSD 3-Clause "New" or "Revised" License
935 stars 368 forks source link

is there a Pyspark example for writing rdd to redis, i'm getting error while importing the import com.redislabs.provider.redis._ #278

Open SrinivasanNagarajaRao opened 3 years ago

mayankasthana commented 3 years ago

Try the Dataframe API.

You won't be able to import anything from this library into pyspark since there is no python library to import.

The Dataframe API or Spark SQL should still work. Follow this https://github.com/RedisLabs/spark-redis/blob/master/doc/dataframe.md, but instead of scala, write similar in python. Do ensure that the spark-redis package or jar is included.

SrinivasanNagarajaRao commented 3 years ago

but how do these guys doing it on. https://support.huaweicloud.com/intl/en-us/devg-dli/dli_09_0097.html https://support.huaweicloud.com/intl/en-us/devg-dli/dli_09_0094.html