ITISFoundation / osparc-simcore

🐼 osparc-simcore simulation framework
https://osparc.io
MIT License
46 stars 27 forks source link

Docker compose timing out #4144

Open GitHK opened 1 year ago

GitHK commented 1 year ago
"The Docker Engine you're using is running in swarm mode.",
"servicelib.long_running_tasks._errors.TaskClientResultError: Task simcore_service_dynamic_sidecar.modules.long_running_tasks.task_create_service_containers.b0ea58ef-81e2-413b-af8b-48626e037cd4 finished with exception: 'Some networks were defined but are not used by any service: staging-simcore_interactive_services_subnet",
"Creating dy-sidecar-2434dc1b-f3d5-4af9-a273-e52233c111aa-3-sym-server    ...",
"Creating dy-sidecar-2434dc1b-f3d5-4af9-a273-e52233c111aa-1-s4l-core      ...",
"Creating network ""dy-sidecar_2434dc1b-f3d5-4af9-a273-e52233c111aa_back----end"" with the default driver",
"Creating dy-sidecar-2434dc1b-f3d5-4af9-a273-e52233c111aa-2-s4l-core-stre ...",
"To deploy your application across the swarm, use `docker stack deploy`.",
"ERROR: for dy-sidecar-2434dc1b-f3d5-4af9-a273-e52233c111aa-3-sym-server  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=120)",
"ERROR: for dy-sidecar-2434dc1b-f3d5-4af9-a273-e52233c111aa-2-s4l-core-stre  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=120)",
"ERROR: for dy-sidecar-2434dc1b-f3d5-4af9-a273-e52233c111aa-3-sym-server  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=120)",
"ERROR: for dy-sidecar-2434dc1b-f3d5-4af9-a273-e52233c111aa-2-s4l-core-stre  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=120)",
"ERROR: for dy-sidecar-2434dc1b-f3d5-4af9-a273-e52233c111aa-1-s4l-core  UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. (read timeout=120)",
"If you encounter this issue regularly because of slow network conditions, consider setting COMPOSE_HTTP_TIMEOUT to a higher value (current value: 120).",

This was already seen in the past and the value was raised to 120 in https://github.com/ITISFoundation/osparc-simcore/pull/3836

GitHK commented 1 year ago

This issue was showing up in AWS staging on an autoscaled node.