streamthoughts / kafka-connect-file-pulse

🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
https://streamthoughts.github.io/kafka-connect-file-pulse/
Apache License 2.0
324 stars 65 forks source link

Kafka File pulse running in infinite loop while processing s3 file #655

Open ritesh-payu opened 3 months ago

ritesh-payu commented 3 months ago

We are using kafka-connect-file-pulse version 2.9.0 in AWS MSK connector.

While processing an S3 file, our MSK connector is running in an infinite loop.

Find find the log below: Logs:

Screenshot 2024-08-01 at 6 13 59 PM