openresty / srcache-nginx-module

Transparent subrequest-based caching layout for arbitrary nginx locations.
http://wiki.nginx.org/NginxHttpSRCacheModule
476 stars 105 forks source link

How to cache terabytes of data #90

Open adityapatadia opened 3 years ago

adityapatadia commented 3 years ago

I would like to use this module but my cache is going to be huge - in multiple terabytes. Both Redis and Memcached are not suitable for this sort of caching. How can I structure my cache to allow me to cache huge amount of data?

kapouer commented 3 years ago

A distributed cache can easily manage terabytes of data. However in my point of view it's a bad design decision to use srcache in your case - whatever it is - if it's going to be terabytes of data it needs a more specific approach than srcache.