search

flyteorg / flyte

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
https://flyte.org
Apache License 2.0
5.43k stars 581 forks source link

[Core Feature]: Allow to configure agent status update frequency #5733

Open thomas-maschler opened 1 week ago

thomas-maschler commented 1 week ago

I have an asynchronous agent that schedules long-running jobs using a third-party service. That service has request quotas. Right now, agents request a status update every 5s. When running many long-running tasks concurrently I frequently run into quota limits and my status updates fail.

I would like to configure the status update frequency for my agent in a similar way I can configure timeouts. https://docs.flyte.org/en/latest/flyte_agents/developing_agents.html#canary-deployment

welcome[bot] commented 1 week ago

Thank you for opening your first issue here! 🛠

pingsutw commented 1 week ago

You should be able to configure it by updating this config

kumare3 commented 1 week ago

@thomas-maschler as @pingsutw said, this is already supported in Agents today. please use this to adjust. @pingsutw maybe we should make it possible to adjust it from the AgentMetadata service (in the future)?