a0x8o / kafka

A high-throughput, distributed, publish-subscribe messaging system
Apache License 2.0
66 stars 172 forks source link

Kakfa Connect: Offsets not being saved in standalone mode #3

Open sgulati89 opened 6 years ago

sgulati89 commented 6 years ago

Hi Team,

We are running kafka connect in standalone mode. We are reading from Kafka and writing to Hdfs. But it is not saving offsets.

When I looked at logs , I can see it is reading the property 'offset.storage.file.filename' INFO Starting FileOffsetBackingStore with file /tmp/filename (org.apache.kafka.connect.storage.FileOffsetBackingStore:59)

However, no file is getting written. Does offsets not get stored in local file if it reads from kafka?

OneCricketeer commented 2 years ago

If you believe this is a bug, please report Kafka Connect issues in JIRA

https://issues.apache.org/jira/browse/KAFKA

Or find the kafka-connect-hdfs project issues instead