search

datahub-project / datahub

The Metadata Platform for your Data and AI Stack
https://datahubproject.io
Apache License 2.0
9.93k stars 2.94k forks source link

Datahub in offline environments (ingestion flows fail) #11839

Open crtvmn opened 1 week ago

crtvmn commented 1 week ago

Describe the bug Install Datahub in an offline environment (no access to https://pypi.python.org). When a flow is running, it fails with the following error:

[988cac6b-5af6-4d99-ae78-f50d603c1cbd logs] error: Request failed after 3 retries
[988cac6b-5af6-4d99-ae78-f50d603c1cbd logs]   Caused by: error sending request for url (https://pypi.python.org/simple/setuptools/)
[988cac6b-5af6-4d99-ae78-f50d603c1cbd logs]   Caused by: operation timed out

Expected behavior Flows can run in offline environment with no error

Additional context Datahub is instlled in a Kubernetes cluster (1.30.3)