qubole / rubix

Cache File System optimized for columnar formats and object stores
Apache License 2.0
183 stars 74 forks source link

Dynamic filter for white-listing locations to cache #28

Closed shubhamtagra closed 8 years ago

shubhamtagra commented 8 years ago

Like "hadoop.cache.data.location.blacklist", we need to add "hadoop.cache.data.location.whitelist" and this should be able to take values which can be evaluated at runtime. E.g. hadoop.cache.data.location.whitelist=mybucket.*/tablename/year=2016/month={currentMonth}

shubhamtagra commented 8 years ago

29 explains this in detail