search

apache / pinot

Apache Pinot - A realtime distributed OLAP datastore
https://pinot.apache.org/
Apache License 2.0
5.53k stars 1.3k forks source link

I am not able to manage offline flows ( from realtime to offline) #7168

Closed deepakcse2k5 closed 3 years ago

deepakcse2k5 commented 3 years ago

Hi ,

I have started Quickstart batch with minions :- bin/quick-start-batch-with-minion.sh

followed instruction from here:- https://docs.pinot.apache.org/operators/operating-pinot/pinot-managed-offline-flows

created realtime table - "tableName": "transcript_realtime", "tableType": "REALTIME".

crated realtime table :-

transcript-table-realtime

create corresponding offline table :-

transcript-table-offline

segment is generated for real time after pushing data via Kafka .

But I am not able to store data into offline table.I am not running pinot in Kubernetes .

please let me know if I am missing anything in the config file .

mayankshriv commented 3 years ago

@deepakcse2k5 As the doc suggests, this managed flow requires setting up Pinot Minion component to run the RealtimeToOfflineSegmentsTask. Unclear from your description if you configured this task to run?

npawar commented 3 years ago

Closing this issue as there's been no activity for > 2 months. Also I believe there have been discussions on the Slack channel about this. Please reopen if issue still exists.