quantile-development / dagster-meltano

A Dagster plugin that allows you to run Meltano in Dagster
MIT License
41 stars 17 forks source link

Test tap and target config capabilities #6

Closed JulesHuisman closed 1 year ago

JulesHuisman commented 2 years ago

Make sure the tap and target configurations injection works with more complex values like:

config:
      files:
        - entity: "sample"
          path: extract/sample.csv
          keys: ["id"]

It currently injects the configuration using environment variables.

@property
def _target_config_env_vars(self):
    return {
        lower_kebab_to_upper_snake_case(f"{self._target}_{config_name}"): value
        for config_name, value in self._target_config.items()
    }