search

PrefectHQ / prefect-airbyte

https://PrefectHQ.github.io/prefect-airbyte/
Apache License 2.0
40 stars 5 forks source link

Prefect Airbyte doesn't work anymore with airbyte 0.40.28 #48

Closed lucienfregosibodyguard closed 1 year ago

lucienfregosibodyguard commented 1 year ago

After upgrading Airbyte to 0.40.28 I got this issue

Encountered exception during execution:
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/prefect_airbyte/client.py", line 154, in trigger_manual_sync_connection
    response.raise_for_status()
  File "/usr/local/lib/python3.10/site-packages/httpx/_models.py", line 749, in raise_for_status
    raise HTTPStatusError(message, request=request, response=self)
httpx.HTTPStatusError: Client error '409 Conflict' for url 'http://airbyte-lfo-webapp.airbyte.svc.cluster.local/api/v1/connections/sync/'
For more information check: https://httpstatuses.com/409

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/prefect/engine.py", line 1481, in orchestrate_task_run
    result = await task.fn(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/prefect_airbyte/connections.py", line 149, in trigger_sync
    ) = await airbyte_client.trigger_manual_sync_connection(connection_id)
  File "/usr/local/lib/python3.10/site-packages/prefect_airbyte/client.py", line 166, in trigger_manual_sync_connection
    raise err.AirbyteServerNotHealthyException() from e
prefect_airbyte.exceptions.AirbyteServerNotHealthyException

Airbyte team told me that It can come from the new loggin/pass authentication https://discuss.airbyte.io/t/airbyte-server-not-healthy-exception-with-prefect-airbyte-starting-or-api-call-with-0-40-28/3792/3

Glad to help if needeed