clingen-data-model / data-exchange-topics

For issue tracking and managing configurations of kafka topics in the dx
0 stars 0 forks source link

Confluent notification that "Connector clingen_topic_gcs_backups has Failed" #45

Open toneillbroad opened 11 months ago

toneillbroad commented 11 months ago

The first email message stated:

Hi,

Unfortunately your connector has Failed.

Unable to validate configuration. If an update was made to the configuration, this means that the configuration was invalid, and the connector continues to operate on a previous configuration that passed validation. Errors: Topic(s) "actionability_dev,broad-dsp-clinvar-clean,genegraph-admin,gene_dosage,broad-dsp-clinvar-backup_2020-10-21" doesn't exist Please check the following configurations: topics

Connector Name: clingen_topic_gcs_backups Connector ID: lcc-mrv5q Cluster ID: lkc-8wx20

I went into confluent and verified that the list of topics provided was previously deleted from the prod cluster. I went into the connector and removed those topics from the configuration. I also verified and documented what topics should be backed up and which were deleted in our tracking spreadsheet.

Upon saving the configuration, I recieved another email from confluent:

Hi,

Unfortunately your connector has Failed.

This connector requires access to a dead letter queue topic. Please grant the Service Account ACLs to create and write to topic with the prefix dlq-lcc.

Connector Name: clingen_topic_gcs_backups Connector ID: lcc-mrv5q Cluster ID: lkc-8wx20

Sent an email to Steve Jahl to have him verify his service account access to the DLQ is valid.

toneillbroad commented 11 months ago

Will monitor to ensure everything is working properly.