qubole / rubix

Cache File System optimized for columnar formats and object stores
Apache License 2.0
182 stars 74 forks source link

Lower DEFAULT_KEY_POOL_MAX_SIZE to smaller value, ideally under 10 #460

Open shubhamtagra opened 3 years ago

shubhamtagra commented 3 years ago

Need some experimentation to figure out a good value but current value of 200 is too big. With 'N' nodes and 2 servers, one node could be handling 2200N connections just for Rubix. With N=100, this easily blows out of proportion.