search

cBioPortal / cbioportal

cBioPortal for Cancer Genomics
https://cbioportal.org
GNU Affero General Public License v3.0
632 stars 484 forks source link

CacheException: javax.cache.CacheException: org.redisson.client.RedisTimeoutException: Command still hasn't been ... #8341

Closed sentry-io[bot] closed 3 years ago

sentry-io[bot] commented 3 years ago

Sentry Issue: CBIOPORTAL-BACKEND-9F8

RedisTimeoutException: Command still hasn't been written into connection! Increase nettyThreads and/or retryInterval settings. Payload size in bytes: 82327. Node source: NodeSource [slot=0, addr=null, redisClient=null, redirect=null, entry=null], connection: RedisConnection@514208478 [redisClient=[addr=redis://redis-persistence-cache-master:6379], channel=[id: 0x2f786a32, L:/100.96.67.109:40442 - R:redis-persistence-cache-master/100.71.171.57:6379], currentCommand=null], command: (EVAL), params: [local expireDateScore = redis.call('zscore', KEYS[2], ARGV[4]);local exists = redis.call('hexists', ..., 8, genie-public-portalGeneralRepositoryCache, jcache_timeout_set:{genie-public-portalGeneralRepositoryCache}, jcache_created_channel:{genie-public-portalGeneralRepositoryCache}, jcache_removed_channel:{genie-public-portalGeneralRepositoryCache}, jcache_updated_channel:{genie-public-portalGeneralRepositoryCache}, jcache_created_sync_channel:{genie-public-portalGeneralRepositoryCache}, jcache_removed_sync_channel:{genie-public-portalGeneralRepositoryCache}, jcache_updated_sync_channel:{genie-public-portalGeneralRepositoryCache}, ...] after 3 retry attempts
    at org.redisson.command.RedisExecutor$2.run(RedisExecutor.java:200)
    at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
    at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
    at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
    at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
...
(1 additional frame(s) were not displayed)

CacheException: org.redisson.client.RedisTimeoutException: Command still hasn't been written into connection! Increase nettyThreads and/or retryInterval settings. Payload size in bytes: 82327. Node source: NodeSource [slot=0, addr=null, redisClient=null, redirect=null, entry=null], connection: RedisConnection@514208478 [redisClient=[addr=redis://redis-persistence-cache-master:6379], channel=[id: 0x2f786a32, L:/100.96.67.109:40442 - R:redis-persistence-cache-master/100.71.171.57:6379], currentCommand=null], command: (EVAL), params: [local expireDateScore = redis.call('zscore', KEYS[2], ARGV[4]);local exists = redis.call('hexists', ..., 8, genie-public-portalGeneralRepositoryCache, jcache_timeout_set:{genie-public-portalGeneralRepositoryCache}, jcache_created_channel:{genie-public-portalGeneralRepositoryCache}, jcache_removed_channel:{genie-public-portalGeneralRepositoryCache}, jcache_updated_channel:{genie-public-portalGeneralRepositoryCache}, jcache_created_sync_channel:{genie-public-portalGeneralRepositoryCache}, jcache_removed_sync_channel:{genie-public-portalGeneralRepositoryCache}, jcache_updated_sync_channel:{genie-public-portalGeneralRepositoryCache}, ...] after 3 retry attempts
    at org.redisson.jcache.JCache.lambda$waitSync$7(JCache.java:661)
    at org.redisson.misc.RedissonPromise.lambda$onComplete$0(RedissonPromise.java:183)
    at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:577)
    at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:570)
    at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:549)
...
(24 additional frame(s) were not displayed)

CacheException: javax.cache.CacheException: org.redisson.client.RedisTimeoutException: Command still hasn't been written into connection! Increase nettyThreads and/or retryInterval settings. Payload size in bytes: 82327. Node source: NodeSource [slot=0, addr=null, redisClient=null, redirect=null, entry=null], connection: RedisConnection@514208478 [redisClient=[addr=redis://redis-persistence-cache-master:6379], channel=[id: 0x2f786a32, L:/100.96.67.109:40442 - R:redis-persistence-cache-master/100.71.171.57:6379], currentCommand=null], command: (EVAL), params: [local expireDateScore = redis.call('zscore', KEYS[2], ARGV[4]);local exists = redis.call('hexists', ..., 8, genie-public-portalGeneralRepositoryCache, jcache_timeout_set:{genie-public-portalGeneralRepositoryCache}, jcache_created_channel:{genie-public-portalGeneralRepositoryCache}, jcache_removed_channel:{genie-public-portalGeneralRepositoryCache}, jcache_updated_channel:{genie-public-portalGeneralRepositoryCache}, jcache_created_sync_channel:{genie-public-portalGeneralRepositoryCache}, jcache_removed_sync_channel:{genie-public-portalGeneralRepositoryCache}, jcache_updated_sync_channel:{genie-public-portalGeneralRepositoryCache}, ...] after 3 retry attempts
    at org.redisson.jcache.JCache.lambda$putAsync$16(JCache.java:1116)
    at org.redisson.misc.RedissonPromise.lambda$onComplete$0(RedissonPromise.java:183)
    at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:577)
    at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:551)
    at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:490)
...
(33 additional frame(s) were not displayed)

javax.cache.CacheException: org.redisson.client.RedisTimeoutException: Command still hasn't been written into connection! Increase nettyThreads and/or retryInterval settings. Payload size in bytes: 82327. Node source: NodeSource [slot=0, addr=null, redisClient=null, redirect=null, entry=null], connection: RedisConnection@514208478 [redisClient=[addr=redis://redis-persistence-cache-master:6379], channel=[id: 0x2f786a32, L:/100.96.67.109:40442 - R:redis-persistence-cache-master/100.71.171.57:6379], currentCommand=null], command: (EVAL), params: [local expireDateScore = redis.call('zscore', KEYS[2], ARGV[4]);local exists = redis.call('hexists', ..., 8, genie-public-portalGeneralRepositoryCache, jcache_timeout_set:{genie-public-portalGeneralRepositoryCache}, jcache_created_channel:{genie-public-portalGeneralRepositoryCache}, jcache_removed_channel:{genie-public-portalGeneralRepositoryCache}, jcache_updated_channel:{genie-public-portalGeneralRepositoryCache}, jcache_created_sync_channel:...
alisman commented 3 years ago

@n1zea144 @sheridancbio hey guys, you might want to take a look at this. somewhat frequent

stale[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.