Service Unavailable responses when using simple configuration

[LuisaoStuff]

I am using the following configuration with the helm chapter deployment option.

config:
  gitlab:
    url: https://git.rz.***.com
    token: ***
  projects:
    - name: ***
    - name: ***
    - name: ***
    - name: ***
    - name: ***

I have modified the helm chapter to suit my situation. I disabled the redis feature and added to the deployment a proxy environment variable due to we are working behind a vpn with a proxy configuration for dns resolution. I will resolve some questions in advance:

• Yes, the pod reaches gitlab, and it does resolves correctly the domain.
• Yes, the gitlab token works, I have tested it with curl from my bash which is connected to the vpn and it is using the proxy also.
• Yes, I have tested both project name path and project id, and I got the same output. Here I leave the ouput:

{"gitlab-endpoint":"https://git.***.com","gitlab-rate-limit":"1rps","level":"info","msg":"configured","time":"2021-12-22T12:52:48Z"}
{"level":"info","msg":"pull projects from wildcards","on-init":"yes","scheduled":"every 1800s","time":"2021-12-22T12:52:48Z"}
{"level":"info","msg":"pull environments from projects","on-init":"yes","scheduled":"every 1800s","time":"2021-12-22T12:52:48Z"}
{"level":"info","msg":"pull refs from projects","on-init":"yes","scheduled":"every 300s","time":"2021-12-22T12:52:48Z"}
{"level":"info","msg":"pull metrics","on-init":"yes","scheduled":"every 30s","time":"2021-12-22T12:52:48Z"}
{"level":"info","msg":"garbage collect projects","on-init":"no","scheduled":"every 14400s","time":"2021-12-22T12:52:48Z"}
{"level":"info","msg":"garbage collect environments","on-init":"no","scheduled":"every 14400s","time":"2021-12-22T12:52:48Z"}
{"level":"info","msg":"garbage collect refs","on-init":"no","scheduled":"every 1800s","time":"2021-12-22T12:52:48Z"}
{"level":"info","msg":"garbage collect metrics","on-init":"no","scheduled":"every 600s","time":"2021-12-22T12:52:48Z"}
{"level":"info","msg":"scheduling projects from wildcards pull","time":"2021-12-22T12:52:48Z","wildcards-count":0}
{"level":"info","msg":"scheduling environments from projects pull","projects-count":5,"time":"2021-12-22T12:52:48Z"}
{"level":"info","msg":"scheduling refs from projects pull","projects-count":5,"time":"2021-12-22T12:52:48Z"}
{"host":"127.0.0.1:8082","level":"info","msg":"internal monitoring listener set","scheme":"tcp","time":"2021-12-22T12:52:48Z"}
{"level":"info","listen-address":":8080","metrics-endpoint-enabled":true,"msg":"http server started","openmetrics-encoding-enabled":false,"pprof-endpoint-enabled":false,"time":"2021-12-22T12:52:48Z","webhook-endpoint-enabled":false}
{"environments-count":0,"level":"info","msg":"scheduling metrics pull","refs-count":0,"time":"2021-12-22T12:52:49Z"}
{"error":"Get \"https://git.***.com/api/v4/projects/***%2F***/repository/branches?page=1\u0026per_page=100\": Service Unavailable","level":"warning","msg":"pulling refs from project","project-name":"***/***","time":"2021-12-22T12:52:52Z"}
{"error":"Get \"https://git.***.com/api/v4/projects/***/repository/branches?page=1\u0026per_page=100\": Service Unavailable","level":"warning","msg":"pulling refs from project","project-name":"***","time":"2021-12-22T12:52:52Z"}
{"error":"Get \"https://git.***.com/api/v4/projects/***%2F***/repository/branches?page=1\u0026per_page=100\": Service Unavailable","level":"warning","msg":"pulling refs from project","project-name":"***/***","time":"2021-12-22T12:52:52Z"}
{"error":"Get \"https://git.***.com/api/v4/projects/***%2F***/repository/branches?page=1\u0026per_page=100\": Service Unavailable","level":"warning","msg":"pulling refs from project","project-name":"***/***","time":"2021-12-22T12:52:53Z"}
{"error":"Get \"https://git.***.com/api/v4/projects/***%2F***/repository/branches?page=1\u0026per_page=100\": Service Unavailable","level":"warning","msg":"pulling refs from project","project-name":"***/***","time":"2021-12-22T12:52:54Z"}
{"environments-count":0,"level":"info","msg":"scheduling metrics pull","refs-count":0,"time":"2021-12-22T12:53:18Z"}

Any clue about this? Some possible missconfiguration? Thanks in advance :)

[LuisaoStuff]

@mvisonneau ?

[mvisonneau]

👋 hey @LuisaoStuff, have you looked into GitLab's logs? This 5xx error being returned might be related to some overwhelming of the API although I am not sure I'll be able to help you much with such issue 🤷