epam / cloud-pipeline

Cloud agnostic genomics analysis, scientific computation and storage platform
https://cloud-pipeline.com
Apache License 2.0
144 stars 58 forks source link

Support ACL caches warmup and constant refreshing #3509

Closed tcibinan closed 2 months ago

tcibinan commented 2 months ago

Background

Cloud Pipeline has support for certain database requests caching. Currently, the following entries access is cached:

There following cache types are supported:

Due to extremely heavy load on ACL Entities cache, sometimes it is better to switch from Redis to Memory cache even though ACL Entities access becomes eventually consistent.

Approach

Introduce cache warmup and constant refreshing for ACL Entities. Additionally, allow to use separate cache types for System Preferences and ACL Entities.