Closed moizarafat closed 1 month ago
Hello,
We were looking at executing the Data Validation Tool from within the Composer as per instructions in https://github.com/GoogleCloudPlatform/professional-services-data-validator/tree/develop/samples/airflow. We are getting versions conflict because DVT needs specific versions of Google Cloud Libraries which conflict with the versions needed by "apache-airflow-providers-google" (Links below).
https://github.com/GoogleCloudPlatform/professional-services-data-validator/blob/210c352ae8a601833a6e34b13972145abc1d49a6/setup.py#L55
https://github.com/apache/airflow/blob/482c0be434cf4cd6d4769634f859cb5e5a243e9d/airflow/providers/google/provider.yaml#L141
Could you please guide us on finding compatible versions for DVT and Airflow Providers Google that can work on a Cloud Composer version? Or if we are missing something.
Thanks, Moiz
Hello,
We were looking at executing the Data Validation Tool from within the Composer as per instructions in https://github.com/GoogleCloudPlatform/professional-services-data-validator/tree/develop/samples/airflow. We are getting versions conflict because DVT needs specific versions of Google Cloud Libraries which conflict with the versions needed by "apache-airflow-providers-google" (Links below).
https://github.com/GoogleCloudPlatform/professional-services-data-validator/blob/210c352ae8a601833a6e34b13972145abc1d49a6/setup.py#L55
https://github.com/apache/airflow/blob/482c0be434cf4cd6d4769634f859cb5e5a243e9d/airflow/providers/google/provider.yaml#L141
Could you please guide us on finding compatible versions for DVT and Airflow Providers Google that can work on a Cloud Composer version? Or if we are missing something.
Thanks, Moiz