search

temporalio / temporal

Temporal service
https://docs.temporal.io
MIT License
10.61k stars 774 forks source link

Add workers autoscaling through KEDA #33

Open mfateev opened 4 years ago

mfateev commented 4 years ago

https://github.com/kedacore/keda

yiminc commented 1 year ago

This sounds like a feature request to SDK?

aakarim commented 1 year ago

Just casting some light on this - we use KEDA with Postgres queries right now to scale our workers when there is more than a predefined number of tasks that our base node pool can handle.

At the moment it's 2 workers base and when there are more than 10 concurrent Workflows we spin up more servers, 5 concurrent Workflows per node. It's working well, but we're always a little worried that the schema will change and break everything. It would be great to abstract this out to a native integration with KEDA.

ross-p-smith commented 1 year ago

I have this working within KEDA using the temporalClient's ListOpenWorkflow method and would love to chat to someone from the temporal maintainers about the best way to get this into the various repos and whether things make sense

febinct commented 11 months ago

PR for the same https://github.com/kedacore/keda/pull/4863/files

RonaldGalea commented 7 months ago

+1 would be a great feature to have. It's common to have specific workers (services) listening on specific task queues. Exposing the size of a given task queue would be a very precise autoscaling metric for those workers.

sinkr commented 1 month ago

My organization would like to see this, too.

henrytseng commented 1 month ago

+1 This would be great to have

justinfx commented 1 month ago

My studio has just started testing Temporal and it would be great to have this feature.