search

redis / redis-om-spring

Spring Data Redis extensions for better search, documents models, and more
MIT License
609 stars 94 forks source link

Scalability concerns using redis om spring #482

Closed nhealthlive closed 2 months ago

nhealthlive commented 5 months ago

Dear, Redis om spring team @bsbodden we are using the library for a large-scale application, where millions of data need to be processed with concurrent writes/reads to/from Redis. we are using redis-om-spring extensively throughout all the services, When we reach a point of stress and load test, a Single node of Redis couldn't handle the load. below are the real-time statistics, We tried to increase the io-threads and VM resources, but unfortunately nothing gives any upper hand to the problem.

I wish is there a way we can have a clustered environment. If Redis om Spring doesn't support clustering please suggest any workarounds for the time being.

image

Any advice is highly appreciated, We are kind of blocked at this point.

Thank you :-)

bsbodden commented 5 months ago

It's a feature that's at the top of list right now, and slated to be in the 1.0.0 release, so pretty soon.

nhealthlive commented 5 months ago

It's a feature that's at the top of list right now, and slated to be in the 1.0.0 release, so pretty soon.

Great thanks for the response, Looking forward to it, Any ETA ? or any advised workarounds for us to proceed for now?

bsbodden commented 2 months ago

Unfortunately, the OSS cluster mode does not support search properly. So, system that use a proxy to a clustered environment are preferred, something like the Redis Enterprise Proxy https://redis.io/blog/redis-enterprise-proxy/