airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.52k stars 4k forks source link

Unable to configure the source connector Google Analytics GA4 on Airbyte running on Azure Kubernetes Cluster. #39423

Open saurabh111222 opened 3 months ago

saurabh111222 commented 3 months ago

Connector Name

source-Google Analytics 4 (GA4)

Connector Version

2.4.2

What step the error happened?

Configuring a new connector

Relevant information

Airbyte is running on AKS cluster which is in private network and we want to load the data from Google Analytics GA4 to some destination. But while configuring the source connection only we are getting the Permission denied and seems like airbyte is trying to write a source_config.json.

Relevant log output

Traceback (most recent call last):
  File "/airbyte/integration_code/main.py", line 8, in <module>
    run()
  File "/airbyte/integration_code/source_google_analytics_data_api/run.py", line 17, in run
    MigrateCustomReportsCohortSpec.migrate(sys.argv[1:], source)
  File "/airbyte/integration_code/source_google_analytics_data_api/config_migrations.py", line 235, in migrate
    cls._modify_and_save(config_path, source, config),
  File "/airbyte/integration_code/source_google_analytics_data_api/config_migrations.py", line 208, in _modify_and_save
    source.write_config(migrated_config, config_path)
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/connector.py", line 71, in write_config
    with open(config_path, "w") as fh:
PermissionError: [Errno 13] Permission denied: 'source_config.json'

Contribute

marcosmarxm commented 3 months ago

Are you using a different service account when deploying Airbyte using Helm? I think the problem is related to the permissions the service account or Airbyte has to access the pods.

saurabh111222 commented 3 months ago

I tried the same by setting up the Airbyte on my local machine(mac) and I am still getting the same error while connecting to Google Analytics GA4 source.

Screenshot 2024-06-12 at 7 36 23 PM
saurabh111222 commented 3 months ago

Are you using a different service account when deploying Airbyte using Helm? I think the problem is related to the permissions the service account or Airbyte has to access the pods.

I am able to connect by downgrading the version of connector Google Analytics GA4 to version (2.0.3).

Screenshot 2024-06-13 at 12 09 12 PM
tanderson-hp commented 3 months ago

I have the same issue, and downgrading to 2.0.3 worked.

marcosmarxm commented 3 months ago

I included the issue in connector team backlog for further investigation.