search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
16.11k stars 4.12k forks source link

Source Bing Ads connection failed #22546

Closed SPAI2022 closed 1 year ago

SPAI2022 commented 1 year ago

Environment

Current Behavior

URLError image

Expected Behavior

Connection should be OK.

Azure application config as Mobile and desktop type, Allow public client flows=YES The same Client ID/Refresh Token/Develop Token are working on my custom API.

If I set Refresh token as '1234', the error message response as "OAuthTokenRequestException('invalid_grant', 'AADSTS9002313: Invalid request. Request is malformed or invalid.\r\nTrace ..."

Azure API can response message, internet access is fine. PS : Google Ads connection is working on the same VM.

Logs

2023-02-03T08:22:08.290082437Z 2023-02-03 08:22:08 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2023-02-03T08:22:08.290162828Z 2023-02-03 08:22:08 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-03T08:22:08.298168003Z 2023-02-03 08:22:08 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-bing-ads:0.1.16 exists... 2023-02-03T08:22:08.330617665Z 2023-02-03 08:22:08 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-bing-ads:0.1.16 was found locally. 2023-02-03T08:22:08.332081745Z 2023-02-03 08:22:08 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-bing-ads-check-06be794b-bfec-4da6-b9a2-1517ecf80ced-0-rrqiy with resources io.airbyte.config.ResourceRequirements@7729b7ee[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-02-03T08:22:08.332102517Z 2023-02-03 08:22:08 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/06be794b-bfec-4da6-b9a2-1517ecf80ced/0 --log-driver none --name source-bing-ads-check-06be794b-bfec-4da6-b9a2-1517ecf80ced-0-rrqiy --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e http_proxy=http://xxxx -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e https_proxy=http://xxxx -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-bing-ads:0.1.16 -e AIRBYTE_VERSION=0.40.22 -e WORKER_JOB_ID=06be794b-bfec-4da6-b9a2-1517ecf80ced airbyte/source-bing-ads:0.1.16 check --config source_config.json 2023-02-03T08:22:08.336871799Z 2023-02-03 08:22:08 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):97 - Reading messages from protocol version 0.2.0 2023-02-03T08:22:17.003928990Z 2023-02-03 08:22:17 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Fetching access token ... 2023-02-03T08:22:17.004087880Z 2023-02-03 08:22:17 ### ERROR i.a.w.i.DefaultAirbyteStreamFactory(internalLog):116 - Check failed 2023-02-03T08:22:17.349895285Z 2023-02-03 08:22:17 INFO i.a.w.t.TemporalAttemptExecution(get):160 - Stopping cancellation check scheduling... 2023-02-03T08:22:17.349913242Z 2023-02-03 08:22:17 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-03T08:22:17.349917674Z 2023-02-03 08:22:17 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK -----

If there are any detail logs, please let me known.

Steps to Reproduce

  1. Setup Bing Ads source

Question

  1. LOG : Fetching access token ... Refresh token was inputted from UI. Why it need access token? Access token will request authentication...
  2. Refresh token will expired Should we update manual? How does it work in cloud version?

Thank you for your time and attention.

natalyjazzviolin commented 1 year ago

@SPAI2022 let's debug this first until we find a way to confidently reproduce the issue. Please post in the forum or Slack. Closing for now.