[enhancement]: Kubernetes Operator / Executor

microsoft / azure-pipelines-agent

Azure Pipelines Agent 🚀

MIT License

1.72k stars 866 forks source link

[enhancement]: Kubernetes Operator / Executor #4828

Open Breee opened 5 months ago

Breee commented 5 months ago

Describe your feature request here

Greetings,

I would like to create a concept fot a Kubernetes Operator/Controller/Executor that is able to:

Be connected to an agent pool
Listen for jobs
For each job:
1. Spawn azure pipelines agents as pod
2. Wait for completion
3. Delete the pod

Conceptionally it would be similar to the gitlab runner kubernetes executor: https://docs.gitlab.com/runner/executors/kubernetes/

Do you guys/gals have plans to work on something similar?

vmapetr commented 5 months ago

Hi @Breee thank you for your question!
We don't have plans for the this yet, but you are welcome to create PR with the concept if you think that the following changes will be useful to the agent. Thanks!

Breee commented 5 months ago

Some guidance would be good on components that would be involved in this. (Or at least some architecture docs)

I think you have some similar functionality when defining container Images in yaml pipelines which could be reused in parts https://learn.microsoft.com/en-us/azure/devops/pipelines/process/container-phases?view=azure-devops

For k8s we could just use https://github.com/kubernetes-client/csharp to spawn pods and do whatever is necessary to get back what we need to send back to azure devops (logs, artifacts, etc)

Breee commented 2 weeks ago

I'd like to come back to this soon @vmapetr -> can someone provide some guidance?