Azure / aksArc

# Welcome to the Azure Kubernetes Service enabled by Azure Arc (AKS Arc) repo This is where the AKS Arc team will track features and issues with AKS Arc. We will monitor this repo in order to engage with our community and discuss questions, customer scenarios, or feature requests. Checkout our projects tab to see the roadmap for AKS Arc!
MIT License
111 stars 45 forks source link

[BUG] Download rate limit at file streaming service #287

Closed Elektronenvolt closed 1 year ago

Elektronenvolt commented 1 year ago

Describe the bug We see a download rate limitation at the file streaming service (SFS) - this slows down or blocks cluster creations and updates. As a workaround we use the offline download feature to fetch images before cluster operations until this is fixed / improved. https://learn.microsoft.com/en-us/azure/aks/hybrid/offline-download

To Reproduce I've re-created and deleted Aks Hybrid clusters multiple times during the day. Finally ending up in download issues of the images. All downloads go over a single public IP. For the first clusters downloads are super-fast, but after a while it get slower and slower

image

Finally ending up in timeouts: image

After a few hours / half a day everything is super fast again: image

Expected behavior

Screenshots

Environment (please complete the following information):

Additional context

Collect log files

Elektronenvolt commented 1 year ago

@abhilashaagarwala - as discussed, we can't reproduce the issue anymore as well. I've installed AKS Hybrid on two sites (different Internet providers), enabled offline download, and fetched all images with Get-AksHciRelease multiple times. This issue doesn't show up anymore. Downloads are at the same speed all the time.