search

pulumi / customer-managed-deployment-agent

Customer managed agent for https://www.pulumi.com/docs/pulumi-cloud/deployments/
Apache License 2.0
0 stars 0 forks source link

Allow Agents to Spawn Concurrent Workers #33

Open MMartyn opened 2 weeks ago

MMartyn commented 2 weeks ago

Hello!

Issue details

I would like the ability to configure an agent to create multiple concurrent workers. Currently, the agents are 1 to 1 which causes deployments to queue if there aren't any idle agents. I figure a knob to control the level of concurrency would be nice so that the cluster maintainers can decide how much elasticity they will permit before queuing.

Affected area/feature

komalali commented 2 weeks ago

This is possible today. You can create as many agents as you want. If they have the same token, they're part of the same pool.

MMartyn commented 2 weeks ago

The issue with that is that the agents are long living so they consume resources even if they aren't needed. I hadn't checked exactly how much they were using so I suppose if it is minimal then it is not a big problem.

rshade commented 2 weeks ago

Are you using kubernetes? If so you can use the replicas to control this. The agent is pretty cheap resource wise as far as I can tell. You could also set requests/limits to constrain it.