tektoncd / pipeline

A cloud-native Pipeline resource.
https://tekton.dev
Apache License 2.0
8.48k stars 1.78k forks source link

All task pods are getting launched on single node #8346

Open jkuma145 opened 5 days ago

jkuma145 commented 5 days ago

Expected Behavior

For each pipelineruns, Pods should be run on multiple nodes. I'm running 5 pipelinerun parallelly which is running all pods on single nodes. I have 5-6 nodes in my cluster where tekton is hosted.

Actual Behavior

Steps to Reproduce the Problem

  1. setp eventlistener, setup TriggerTemplate and refer to pipeline which should run your task on multiple nodes.

Additional Info

Client Version: v1.29.0
Kustomize Version: v5.0.4-0.20230601165947-6ce0bf390ce3
Server Version: v1.25.6
v0.61.1

I'm trying to tekton cluster in HA even, but most of pods are running on single node only.

tektonpipelines

AlanGreene commented 5 days ago

Can you share an example of a PipelineRun exhibiting this behaviour? Depending on what it's doing this may be expected.

See https://tekton.dev/docs/pipelines/affinityassistants/

coschedule workspaces - When a PersistentVolumeClaim is used as volume source for a Workspace in a PipelineRun, all TaskRun pods within the PipelineRun that share the Workspace will be scheduled to the same Node. (Note: Only one pvc-backed workspace can be mounted to each TaskRun in this mode.)

coschedule workspaces is the default behaviour, but other options are available including disabling the affinity assistant as described on that page.

If your PipelineRuns are not using a PVC as described, please share more details to help understand and reproduce the behaviour.

jkuma145 commented 4 days ago

Hello I'm running 5 pipelinerun parallely for 5 applications. Pipelineruns -> Taskruns -> Pods which are executing on single node for all 5 pipelinerun. I can understand that single pipelinerun can run multiple task and multiple pods on single node as we are sharing the workspace using coherent. but unexpected behavior is all pipelinerun running all pods on single node only.

attached pod sample

image