teragrep / pth_06

Teragrep Datasource for Apache Spark
GNU Affero General Public License v3.0
0 stars 5 forks source link

Kafka query doesn't cut to the offset set on the start of the query #59

Closed StrongestNumber9 closed 3 weeks ago

StrongestNumber9 commented 2 months ago

Describe the bug

Kafka queries keeps on processing more and more data if someone is writing to the topic it is reading from

Expected behavior

Reads until the offset set on the start of the query so the queries can actually stop at some point

How to reproduce

Run kafka query while active kafka writer keeps on writing to the topic

Screenshots

Software version

I think version 5.1.0-7-g87a76018 is currently running

Desktop (please complete the following information if relevant):

Additional context