qubole / rubix

Cache File System optimized for columnar formats and object stores
Apache License 2.0
183 stars 74 forks source link

Study the ratio of non-local reads for different cluster sizes #123

Open vrajat opened 6 years ago

vrajat commented 6 years ago

@wishnick's experiments have thrown up an interesting dependence between ratio of local/non-local reads relative to the cluster size. We have not studied the effect of cluster size on these metrics. A better understanding is required to prioritize projects to either improve the performance of non-local reads as well as control the ratio of local/non-local reads as the cluster size changes.