streamthoughts / kafka-connect-file-pulse

🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
https://streamthoughts.github.io/kafka-connect-file-pulse/
Apache License 2.0
316 stars 61 forks source link

AWS S3 Exception #630

Open srikanthvpai opened 3 months ago

srikanthvpai commented 3 months ago

Hi Team,

We keep on getting this error in one of our servers even if the connector is working fine and processing the data.

com.amazonaws.services.s3.model.AmazonS3Exception: Not Found (Service: Amazon S3; Status Code: 404; Error Code: 404 Not Found;

Looks like its a problem related to trying to access files which are not present in the bucket (but the file is already processed by the connector fine). Any idea why this is happening ?

Regards

srikanthvpai commented 3 months ago

This happens repeatedly even if there is nothing to poll from S3 bucket