datahub-project / datahub

The Metadata Platform for your Data and AI Stack
https://datahubproject.io
Apache License 2.0
9.93k stars 2.94k forks source link

fix(ingest/lookml): replace class variable with instance variable for improved encapsulation #11881

Closed raudzis closed 3 days ago

raudzis commented 3 days ago

This pull request addresses an issue caused by the use of class variables in the LookML pipelines. When multiple pipelines are executed in the same runtime environment, class variables can lead to conflicts, as they are shared across all instances and are not instance-specific.

To resolve this, class variables have been replaced with instance variables, ensuring that each pipeline instance maintains its own independent state.

Changes Replaced class variables with instance variables to prevent state conflicts. Impact This change ensures proper isolation of variables between pipeline instances, eliminating errors when multiple pipelines run simultaneously.

Checklist