pricingblock-project
commented
1 week ago another log
~~~~ Execution Summary - RUN_INGEST ~~~~
Execution finished with errors.
{'exec_id': 'cbfb6c8f-082b-49c5-9235-0487a0b7075d',
'infos': ['2024-10-11 10:13:43.339194 INFO: Starting execution for task with name=RUN_INGEST',
"2024-10-11 10:21:58.047478 INFO: Failed to execute 'datahub ingest', exit code 2",
'2024-10-11 10:21:58.048656 INFO: Caught exception EXECUTING task_id=cbfb6c8f-082b-49c5-9235-0487a0b7075d, name=RUN_INGEST, '
'stacktrace=Traceback (most recent call last):\n'
' File "/datahub-ingestion/.venv/lib/python3.10/site-packages/acryl/executor/execution/default_executor.py", line 139, in execute_task\n'
' task_event_loop.run_until_complete(task_future)\n'
' File "/usr/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete\n'
' return future.result()\n'
' File "/datahub-ingestion/.venv/lib/python3.10/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 400, in '
'execute\n'
' raise TaskError("Failed to execute \'datahub ingest\'")\n'
"acryl.executor.execution.task.TaskError: Failed to execute 'datahub ingest'\n"],
'errors': []}
~~~~ Ingestion Logs ~~~~
Obtaining venv creation lock...
Acquired venv creation lock
venv doesn't exist.. minting..
Using Python 3.10.12 interpreter at: /usr/bin/python3
Creating virtualenv at: /tmp/datahub/ingest/venv-postgres-3cbb1ad0ed8a0388
Resolved 3 packages in 3.87s
Prepared 3 packages in 42.25s
Installed 3 packages in 774ms
+ pip==24.2
+ setuptools==75.1.0
+ wheel==0.44.0
+ uv pip install 'acryl-datahub[datahub-rest,datahub-kafka,postgres]==0.14.1'
Resolved 170 packages in 1m 14s
error: Failed to prepare distributions
Caused by: Failed to fetch wheel: pandas==2.2.3
Caused by: Failed to extract archive
Caused by: Failed to download distribution due to network timeout. Try increasing UV_HTTP_TIMEOUT (current value: 30s).docker logs -f datahub-datahub-gms-1 |grep postgres
2024-10-11 10:52:15,221 [ForkJoinPool.commonPool-worker-5] INFO c.l.m.entity.EntityServiceImpl:947 - Ingesting aspects batch to database: AspectsBatchImpl{items=[ChangeMCP{changeType=UPSERT, urn=urn:li:dataHubIngestionSource:ebb4e10e-6006-4790-9998-2ee55ff30a62, aspectName='dataHubIngestionSourceInfo', recordTemplate={name=timeseries_188, schedule={timezone=Asia/Shanghai, interval=0 0 * * *}, type=postgres, config={recipe={"source":{"type":"postgres","config":{"host_port":"192.168.50.188:5432","database":"timeseries","username":"postgres","include_tables":true,"incl..., systemMetadata={lastObserved=1728643935210, version=1, properties={appSource=ui}}}, ChangeMCP{changeType=CREATE, urn=urn:li:dataHubIngestionSource:ebb4e10e-6006-4790-9998-2ee55ff30a62, aspectName='dataHubIngestionSourceKey', recordTemplate={id=ebb4e10e-6006-4790-9998-2ee55ff30a62}, systemMetadata={lastObserved=1728643935210, version=1, properties={appSource=ui}}}]}
2024-10-11 10:52:17,397 [ForkJoinPool.commonPool-worker-13] INFO c.l.m.entity.EntityServiceImpl:947 - Ingesting aspects batch to database: AspectsBatchImpl{items=[ChangeMCP{changeType=UPSERT, urn=urn:li:dataHubExecutionRequest:1c634b5b-0111-4328-a7fc-4f74dfe62ff7, aspectName='dataHubExecutionRequestInput', recordTemplate={args={recipe={"run_id":"urn:li:dataHubExecutionRequest:1c634b5b-0111-4328-a7fc-4f74dfe62ff7","source":{"type":"postgres","config":{"include_tables":true,"database":"timeseries","password":"${timeseries_188}","profiling":{"enabled":true,"profile_table_l..., systemMetadata={lastObserved=1728643937386, version=1, properties={appSource=ui}}}, ChangeMCP{changeType=CREATE, urn=urn:li:dataHubExecutionRequest:1c634b5b-0111-4328-a7fc-4f74dfe62ff7, aspectName='dataHubExecutionRequestKey', recordTemplate={id=1c634b5b-0111-4328-a7fc-4f74dfe62ff7}, systemMetadata={lastObserved=1728643937386, version=1, properties={appSource=ui}}}]}
Creating virtualenv at: /tmp/datahub/ingest/venv-postgres-3cbb1ad0ed8a0388
Creating virtualenv at: /tmp/datahub/ingest/venv-postgres-3cbb1ad0ed8a0388
Creating virtualenv at: /tmp/datahub/ingest/venv-postgres-3cbb1ad0ed8a0388
Creating virtualenv at: /tmp/datahub/ingest/venv-postgres-3cbb1ad0ed8a0388
Creating virtualenv at: /tmp/datahub/ingest/venv-postgres-3cbb1ad0ed8a0388
Creating virtualenv at: /tmp/datahub/ingest/venv-postgres-3cbb1ad0ed8a0388
Creating virtualenv at: /tmp/datahub/ingest/venv-postgres-3cbb1ad0ed8a0388
david-leifker
Describe the bug
Ingestion failed to complete, or completed with errors.
To Reproduce Steps to reproduce the behavior:
Expected behavior running
Screenshots If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):
OS: [e.g. ubuntu] Browser [e.g. chrome] Version [e.g. 22] chrome version: 120.0.6099.216, docker version: Docker version 24.0.7, build afdd53b, ubuntu version: Ubuntu 20.04.1 LTS
Additional context