apache / pinot

Apache Pinot - A realtime distributed OLAP datastore
https://pinot.apache.org/
Apache License 2.0
5.5k stars 1.29k forks source link

Scheduled data load into Dimensional table #12801

Open vineethvp opened 7 months ago

vineethvp commented 7 months ago

We have certain dimensional tables for which data comes from kafka topics. Is there a way to push the data to dimensional table in a fixed interval?

Can this be done using Pinot managed Offline flows or real-time to offline job functionality in Pinot?

vineethvp commented 7 months ago

@Jackie-Jiang Any suggestions on this?

Jackie-Jiang commented 7 months ago

cc @snleee @swaminathanmanish