search

confluentinc / kafka-connect-jdbc

Kafka Connect connector for JDBC-compatible databases
Other
22 stars 958 forks source link

Kafka Connect JDBC doesn't push new records to Kafka Topic unless the connector is restarted #501

Open ivatka opened 6 years ago

ivatka commented 6 years ago

Hi,

We have a Kafka Connect JDBC Source Connector which keeps polling for new records in a Oracle table every minute and push the new records to Kafka Topic. New records are determined by an incrementing column.

In general everything works well but once in a while we see that even though there were new records with incrementing column those records doesn't get pushed to the Topic. There is no clue of any error in the logs and the connector is in running state. Only after we restart the Connector the new records are pushed to the Topic.

Any idea in what situation can this happen?. Can a temporary DB outage cause this situation?.

Rgds Kashyap.

rhauch commented 5 years ago

Perhaps enable DEBUG logs to get a more detailed explanation of what the connector is doing. Are you using a recent version of the connector? If not, consider upgrading.

trav-sriderleck commented 5 years ago

Had a similar issue with Oracle Source in timestamp+incrementing . Restarting the connector added a few records before it paused again. Issue disappeared when we added a new (totally unrelated) connector.

unasd commented 4 years ago

Had a similar issue with Oracle Source in timestamp+incrementing . Restarting the connector added a few records before it paused again. Issue disappeared when we added a new (totally unrelated) connector.

Same hear. Is there any solution?

eslynunez commented 6 months ago

Here in 2024 with the same question. Will update with a comment for any poor soul that ends up here looking for an answer

odorT commented 1 week ago

same