search

delta-io / kafka-delta-ingest

A highly efficient daemon for streaming data from Kafka into Delta Lake
Apache License 2.0
337 stars 71 forks source link

end_at_last_offsets flag is always set #158

Closed kyrre closed 7 months ago

kyrre commented 7 months ago

The following always evaluates to true:

https://github.com/delta-io/kafka-delta-ingest/blob/3eac101bccd0b3900374004384444ae6cd43f98a/src/main.rs#L138

https://github.com/delta-io/kafka-delta-ingest/blob/3eac101bccd0b3900374004384444ae6cd43f98a/src/main.rs#L425-L430

I have no idea why this happens, but the same issue is discussed in this post and seems to be related to clap4.

rtyler commented 7 months ago

I believe @mightyshazam fixed this with #159