apache / pinot

Apache Pinot - A realtime distributed OLAP datastore
https://pinot.apache.org/
Apache License 2.0
5.48k stars 1.28k forks source link

storing json in a columnar format #7152

Open LiranBri opened 3 years ago

LiranBri commented 3 years ago

when storing a json, it would be beneficial to store it in a columnar format so each indexed field is treated like a column in a regular table. then Pinot can possibly be able to also use different kinds of indexes on the values and not just inverted index, as well as other benefits of storing in columnar format (compression, etc)

xiangfu0 commented 3 years ago

Pinot data are stored in columnar format and have multiple index supports. Please see: https://docs.pinot.apache.org/basics/indexing

LiranBri commented 3 years ago

actually @kishoreg asked me to open this issue so he can document and explain the work in progress for this issue