search

RedisLabs / spark-redis

A connector for Spark that allows reading and writing to/from Redis cluster
BSD 3-Clause "New" or "Revised" License
939 stars 372 forks source link

Spark 3.0 support #253

Open dggc opened 4 years ago

dggc commented 4 years ago

Hi, how are you doing?

Does the 2.4.0 version for this library support the new Spark 3.0 release?

Thanks!

fe2s commented 4 years ago

Hi @dggc , We will need to recompile the source base with Spark 3.0 dependencies and run the tests to answer this question. We haven't done this yet.

dggc commented 4 years ago

Ok, thanks!

Daniel Galinkin

On Wed, Jul 8, 2020 at 5:41 AM Oleksiy Dyagilev notifications@github.com wrote:

Hi @dggc https://github.com/dggc , We will need to recompile the source base with Spark 3.0 dependencies and run the tests to answer this question. We haven't done this yet.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/RedisLabs/spark-redis/issues/253#issuecomment-655379007, or unsubscribe https://github.com/notifications/unsubscribe-auth/AABA33BQF4WEW66TRBOCH53R2QWLTANCNFSM4OMFXXNQ .

jackwellsxyz commented 4 years ago

Hello! Any updates? I'd love to use Redis with Spark 3. Thanks!

drauschenbach commented 4 years ago

I’ve been using Spark-Redis ever since Spark 3 shipped and it is working great.

I know the version numbers of the jar looks worrisome since they reference old Spark versions. But it works.

mashuai191 commented 4 years ago

I’ve been using Spark-Redis ever since Spark 3 shipped and it is working great.

I know the version numbers of the jar looks worrisome since they reference old Spark versions. But it works.

useful info! This remove my worry.

alexott commented 3 years ago

See #282