seqeralabs / wave

On-demand containers provisioning service
https://seqera.io/wave/
GNU Affero General Public License v3.0
35 stars 4 forks source link

[Enhancement] - Redis Support clustered mode. #714

Open gavinelder opened 1 month ago

gavinelder commented 1 month ago

Background

Enterprise customers typically deploy Redis in cluster mode for production environments to ensure high availability and scalability. Wave's current Redis deployment only supports standalone mode, which doesn't align with enterprise operational requirements for resilient services.

This requires customers to either accept reduced reliability or seek additional approvals for operating Redis in a non-standard configuration within their environment.

Requirements

Success Criteria

References

https://redis.io/docs/latest/operate/oss_and_stack/management/scaling/ https://aws.amazon.com/blogs/database/work-with-cluster-mode-on-amazon-elasticache-for-redis/

pditommaso commented 2 weeks ago

@munishchouhan was anything solution found for this?

munishchouhan commented 2 weeks ago

@munishchouhan was anything solution found for this?

yes, jedis does support cluster mode We can add a flag for cluster and implement client for this I will work on this, after creating registry dashboards https://redis.io/docs/latest/develop/connect/clients/java/jedis/#:~:text=Jedis%20is%20a%20synchronous%20Java,Redis%20or%20Redis%20Stack%20server.

munishchouhan commented 2 weeks ago

RedisStorage in Spillway does not support JedisCluster

Reason: JedisCluster doesn’t support Pipeline and Transaction https://github.com/redis/jedis/issues/1065

munishchouhan commented 2 weeks ago

Relevent links: https://github.com/brianfrankcooper/YCSB/pull/1535/files