danielgerlag / workflow-core

Lightweight workflow engine for .NET Standard
MIT License
5.4k stars 1.2k forks source link

7k requests a minute to azure blob storage #1263

Open essial opened 6 months ago

essial commented 6 months ago

Describe the bug I have a 4-node setup that utilizes Azure ServiceBus event hub, AzureSynchronization, and CosmosDbPersistance. Under minimal load (eg no active workflows) I'm getting a constant throughput of 7,000 requests to azure blob storage, consuming about 8mb per minute. Specifically it's calls to GetMessageRead that's happening.

To Reproduce Create a workflow core service in Kubernetes with multiple nodes, utilizing all features of the azure extensions.

Expected behavior Less than 7k transactions a minute on an idle workflow instance.

Additional context It will bump up to 10k requests when busy, but only ever drops back down to 7k a minute.