search

acryldata / datahub-actions

DataHub Actions is a framework for responding to changes to your DataHub Metadata Graph in real time.
42 stars 47 forks source link

fix(kafka-event-source): add namespace to avoid duplicates error when using multiple pipelines #47

Closed ngamanda closed 2 years ago

ngamanda commented 2 years ago

Deploying multiple kafka source action pipelines causes the following error to appear:

ValueError: Duplicated timeseries in CollectorRegistry: {'kafka_offset'}

and 

ValueError: Duplicated timeseries in CollectorRegistry: {'kafka_messages_count', 'kafka_messages_count_created', 'kafka_messages_count_total'}

The fix adds a namespace to the metrics to avoid name collisions.

This occured when deploying without enabling metrics