INFO ApplicationMaster: Final app status: FAILED, exitCode: 15, (reason: User class threw exception: java.lang.ArrayIndexOutOfBoundsException: 0

RedisLabs / spark-redis

A connector for Spark that allows reading and writing to/from Redis cluster

BSD 3-Clause "New" or "Revised" License

939 stars 372 forks source link

INFO ApplicationMaster: Final app status: FAILED, exitCode: 15, (reason: User class threw exception: java.lang.ArrayIndexOutOfBoundsException: 0 #301

Closed YINGPENGZH closed 3 years ago

YINGPENGZH commented 3 years ago

I fail to inert three words in redis by using spark, and always get java.lang.ArrayIndexOutOfBoundsException: 0. My spark version is 2.4 and spark-redis_2.11.

val wc = sc.parallelize(List( ("hello", "1") )) sc.toRedisHASH(wc, "map1") sc.toRedisHASH(wc, "map2") sc.toRedisHASH(wc, "map3")

fe2s commented 3 years ago

Hi @YINGPENGZH , I cannot reproduce, works for me. Could you please share the full listing of stack trace and the full listing of your code?

YINGPENGZH commented 3 years ago

Hi @YINGPENGZH , I cannot reproduce, works for me. Could you please share the full listing of stack trace and the full listing of your code?

I find the problem, our clusters lead to spark-redis cannot connect success, thank you so much.