microsoftgraph / msgraph-sdk-dotnet

Microsoft Graph Client Library for .NET!
https://graph.microsoft.com
Other
696 stars 247 forks source link

Retry handler smart queue #429

Open MIchaelMainer opened 5 years ago

MIchaelMainer commented 5 years ago

Concurrent calls can hit the same throttling limit. We want separate threads that hit the same throttling limit to co-respect the throttling limit.

Throttling limits are workload specific. This means that we need to manage retry queues based on calls to the same backend. We will need a heuristic, workload map, and/or regex to determine whether a retry call needs to be added to a queue.

This will require investigation and design spec. The design will be applicable across platforms but we will implement for .Net. AB#7330

ddyett commented 1 year ago

adding this as possible work item to PM review.