timoklimmer / powerproxy-aoai

Monitors and processes traffic to and from Azure OpenAI endpoints.
MIT License
100 stars 26 forks source link

Using stream causing a code: "ECONNRESET" #65

Closed krohm closed 6 months ago

krohm commented 6 months ago

When using stream:true we get image

timoklimmer commented 6 months ago

Hi @krohm, are you using the latest version? I remember there was an issue in an earlier version which has been fixed meanwhile. I also checked your example against the latest version and did not encounter any issues. You might also want to check your config and for example make sure that the deployment used in your script actually exists. Unfortunately, due to the streaming protocol, we cannot provide more details in the streaming result, but if you look at the console output of PowerProxy, you will see a more detailed exception.

krohm commented 6 months ago

hi @timoklimmer , thanks for the hint. Indeed, it was a not configured Log Analytics Section in the config.