openai / openai-dotnet

The official .NET library for the OpenAI API
https://www.nuget.org/packages/OpenAI
MIT License
1.53k stars 156 forks source link

InternalsVisibleTo for Azure.AI.OpenAI #259

Open stephentoub opened 1 month ago

stephentoub commented 1 month ago

Service

OpenAI

Describe the bug

https://github.com/openai/openai-dotnet/blob/ef201cd6016bc1111be4c0098fd643554d6e9a0b/src/OpenAI.csproj#L54-L57

The OpenAI library is tracking all received properties and storing them into a SerializedAdditionalRawData dictionary. It doesn't publicly expose this data, except via InternalsVisibleTo to Azure.AI.OpenAI.

Why is Azure.AI.OpenAI special here, such that this data is only available to that specific library?

Steps to reproduce

Try to access additional properties sent down as part of an OpenAI-compatible response. You can't.

Code snippets

No response

OS

Any

.NET version

Any

Library version

2.1.0-beta

KrzysztofCwalina commented 1 month ago

We will be exposing this publicly. We just did not have time to design it properly in v1.

JadynWong commented 1 month ago

Expect extra_body, extra_headers to be supported like the Python version.

fartwhif commented 1 week ago

can't wait

I understand everything is beta and preview and "happening". But I'm just saying that the "you've been rate limited" failure information is extra important for those using realtime with only 100 RPD Thanks for your time.

ConversationResponseFinishedUpdate.StatusDetails.SerializedAdditionalRawData

{{"type":"requests","code":"rate_limit_exceeded","message":"Rate limit reached for 
gpt-4o-realtime-preview in organization org-XXXXXXXXXXXXXXXXXXXXXXXXXX on requests 
per day (RPD): Limit 100, Used 100, Requested 1. Please try again in 14m24s. 
Visit https://platform.openai.com/account/rate-limits to learn more."}}