search

ublue-os / forge

On-prem Universal Blue
Apache License 2.0
28 stars 1 forks source link

Pushing large image to registry results in Error: writing blob: uploading layer chunked: StatusCode: 499, "Client Closed Request" #52

Closed tepene closed 1 month ago

tepene commented 1 month ago

Describe the bug

The build job is also pushing the image to registry. This steps fails with Error: writing blob: uploading layer chunked: StatusCode: 499, "Client Closed Request" when the image is quite large, like bluefin.

What did you expect to happen?

Pushing image should not result in error. No matter what the size

Extra information or context

No response

tepene commented 1 month ago

Might be related to the resources limits in the pod configuration. But after disabling them i get write tcp 127.0.0.1:43412->127.0.0.1:443: write: broken pipe. port 443 is mapped to traefik reverse proxy. Might be an issue there

tepene commented 1 month ago

added the label traefik.http.serverstransports.registry.forwardingtimeouts.dialTimeout: "900s" to the registry container. Upload worded. Default dialTimout is 30s, i hope 900s is safe enough.

Source: https://doc.traefik.io/traefik/routing/services/#forwardingtimeouts

tepene commented 1 month ago

I removed the label traefik.http.serverstransports.registry.forwardingtimeouts.dialTimeout: "900s" since it also worked without it. After re-configuring the build_project.yml playbook the jobs were running ok. Closing here and will re-open if need be.