search

aws-samples / msk-connect-custom-plugin-jmx

MIT No Attribution
3 stars 1 forks source link

Looking for something similar for mongoDB source connector and s3 sink connector #1

Open saurabhshma opened 4 months ago

saurabhshma commented 4 months ago

Hi, I looks like a cool plugin for pushing jmx metrics. I was also looking for doing something similar in mongoDB source connector and s3 sink connector. Can you please suggest how can I go about creating one for it?

techy-sharmila commented 1 month ago

Hi, Thank you for reaching out and apologies for the delay in responding.

You can leverage the monitoring capabilities provided by MonggoDB connector to export its JMX metrics from MSK Connect by developing a custom module for the MongoDB connector following the approach used for Debezium MySQL Connector in the repository.

Specifically, you would need to :

  1. Extend the connector class for mongo db connector
  2. Override its start method and
  3. Implement the logic to get the configuration details and connect to the JMX server of the MongoDB connector using the JMXEndpointURL.

Your implementation would look similar to the DebeziumMySqlMetricsConnector.

Then you can package and deploy the custom module as a MSK Connect Custom Plugin to export the JMX metrics.