Azure / azure-sdk-for-python

This repository is for active development of the Azure SDK for Python. For consumers of the SDK we recommend visiting our public developer docs at https://learn.microsoft.com/python/azure/ or our versioned developer docs at https://azure.github.io/azure-sdk-for-python.
MIT License
4.61k stars 2.82k forks source link

Connection Reset by Peer in Function App #35319

Closed obs-gh-nikhildua closed 6 months ago

obs-gh-nikhildua commented 6 months ago

Describe the bug Hi there! Not sure if this is directly related to Python or Function app issue. We have a function app that is running on Azure located here: https://observeinc.s3.us-west-2.amazonaws.com/azure/azure-collection-functions-0.11.0.zip

About 5-10% of the invocations, we see a "Connection Reset by Peer" issue and unsure how to resolve it. We're also not sure if its detrimental if this causes the function worker to crash, as the function app is responsible for sending data externally and we don't want data to get dropped if this error is seen.

To Reproduce

  1. Run Function App for a while to collection invocations

Expected behavior Error should not occur

Screenshots

Screenshot 2024-04-23 at 11 31 59 AM

Error:

Full Exception :
 Microsoft.Azure.WebJobs.Script.Workers.WorkerProcessExitException : python exited with code 255 (0xFF) 
 System.Exception : urllib3.exceptions.ProtocolError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')),    raise ConnectionError(err, request=request),requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))    End of inner exception

Additional context Add any other context about the problem here.

github-actions[bot] commented 6 months ago

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @ahmedelnably @fabiocav.

obs-gh-nikhildua commented 6 months ago

I have tried increasing the FUNCTIONS_WORKER_PROCESS_COUNT to 2 and still saw the same issue.

obs-gh-nikhildua commented 6 months ago

Hi there! Wanted to see if anyone had a chance to look into this error? Thank you!

xiangyan99 commented 6 months ago

It seems like a service issue.

Please open a service ticket for the help.