apache / pinot

Apache Pinot - A realtime distributed OLAP datastore

https://pinot.apache.org/

Apache License 2.0

5.46k stars 1.28k forks source link

Operational Intelligence: Using Pinot as Backend for Timeseries Data #7388

Open elonazoulay opened 3 years ago

elonazoulay commented 3 years ago

We have a request to use pinot to process time series data. This issue will track the progress of adding time series functionality to Pinot.

lfeagan commented 3 years ago

As someone looking to use Pinot for storing time series data right now, I am assuming that by processing you are referring to adding time series analytical functions such as decaying average, sliding windows, etc, right?

kishoreg commented 3 years ago

@elonazoulay can you please start a design doc on what you plan to add

elonazoulay commented 3 years ago

Yes, some example functions:

locf: last observation carried forward
gapfill: similar to the seq sql function, fill in a gap with specified granularity
linear interpolation: interpolate between 2 values, interpolate aggregates, ex. interpolate(avg(<col1))

Jackie-Jiang commented 2 years ago

7422 for the design for some time-series aggregation

jackjlli commented 2 years ago

https://github.com/apache/pinot/issues/7213 for the design of generic window functions (sliding window, rolling average, etc).