search

InitialDLab / Simba

Spatial In-Memory Big data Analytics
Apache License 2.0
121 stars 62 forks source link

Columnar storage for index structure #15

Open gfl94 opened 8 years ago

gfl94 commented 8 years ago

We can integrate IndexManger together with CacheManager, IndexManager use a bytebuffer for IndexInfo storage, and CacheManager use a column store for CacheData and CacheInfo, perhaps we can put them together?

dongx-psu commented 8 years ago

No, this is not the case. I mean we can give users a choice to replace the Array[InternalRow] in IPartition to columnar format like the original Spark SQL cache mechanism.