search

VladRodionov / bigbase

BigBase - read optimized, fully HBase-compatible, NoSQL Data Store
GNU Affero General Public License v3.0
9 stars 1 forks source link

Block cache: preserve cache during compaction #4

Open VladRodionov opened 10 years ago

VladRodionov commented 10 years ago

Major feature. During compaction (minor and major) block cache invalidates old blocks but new ones are not added to the cache. We need compaction to be block hotness - aware to put new block into the cache if block 'hotness' index is high. The placement may be into L2/L3 or into L3 only.

The work will done under Apache HBase JIRA: https://issues.apache.org/jira/browse/HBASE-5263

VladRodionov commented 10 years ago

One optimization trick to improve reads: cache INDEX and BLOOM blocks on write (disabled by default).