search

reportportal / kubernetes

Kubernetes/Helm configs for ReportPortal
https://reportportal.io
Apache License 2.0
74 stars 191 forks source link

some pods that are stuck in "pending" state after deployment with Kubernetes #423

Open antonadamov opened 5 days ago

antonadamov commented 5 days ago

could you please help with an issue I'm facing after deploying RP using the Helm chart? After running Installing the Chart commands, multiple pods are stuck in "pending" state. There are no resource issues on the EKS cluster. pods that are stuck: uat, analyzer, api, jobs, metrics, and opensearch cluster master

Pink-Bumblebee commented 3 days ago

@antonadamov , is your problem still actual? If yes, please provide additional information about your environment and please attach some logs of services that stuck in "pending" state.

c0demonky commented 2 days ago

[2024-09-16 15:06:01] Waiting for job mgp-tip-report-portal-reportportal-migrations... [2024-09-16 15:06:07] Waiting for job mgp-tip-report-portal-reportportal-migrations... [2024-09-16 15:06:13] Waiting for job mgp-tip-report-portal-reportportal-migrations... [2024-09-16 15:06:19] Waiting for job mgp-tip-report-portal-reportportal-migrations...

these logs are from the "migrations-waiting-init" pod in one of the pending containers. all pending containers have this pod repeating the same message

wait-for-it.sh: waiting for mgp-tip-report-portal-postgresql.default.svc.cluster.local:5432 without a timeout wait-for-it.sh: waiting for opensearch-cluster-master.default.svc.cluster.local:9200 without a timeout wait-for-it.sh: mgp-tip-report-portal-postgresql.default.svc.cluster.local:5432 is available after 15 seconds no change

these are the only logs from the migrations container

Pink-Bumblebee commented 2 days ago

@antonadamov, please provide more information: are you trying to install with external Postgres? Have you installed Ingress Controller https://reportportal.io/docs/installation-steps-advanced/ComponentsOverview#gateway ?

antonadamov commented 1 day ago

@Pink-Bumblebee , @c0demonky worked on the deployment. @c0demonky please provide requested details

c0demonky commented 1 day ago

@Pink-Bumblebee we are running this service on an enterprise eks node. I created a dns record and cname to route requests to the services, which are reachable but showing 503 -- aside from UI and Index. I installed by cloning the master kubernetes repo https://github.com/reportportal/kubernetes/blob/master/reportportal/Chart.yaml and installing helm chart and deploying through kubectl

hlebkanonik commented 1 minute ago

Hi! Regarding our workflow, the Helm Chart first deploys PostgreSQL, RabbitMQ, and OpenSearch. Next, the Migration service prepares the database and OpenSearch. Once the migration is complete, the remaining services will start running.

Could you please share the status and logs of all services? This will help me understand in which step we have a problem.