Closed isaacseymour closed 1 month ago
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 99.04%. Comparing base (
774fc9d
) to head (c85f781
). Report is 60 commits behind head on master.
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
Describe the change
store
in request: this param allows you to opt a completion request in to being stored, for use in distillations and evals.usage.completion_tokens_details.audio_tokens
in response: tracking audio tokens generatedusage.prompt_tokens_details
in response: tracking tokens used in the promptProvide OpenAI documentation link https://platform.openai.com/docs/api-reference/chat/create#chat-create-store https://platform.openai.com/docs/api-reference/chat/object#chat/object-usage
Describe your solution Currently it's not possible to opt a completion request in to being stored using go-openai, blocking usage of distillations and evals.
It's also not possible to track usage of audio tokens, nor prompt caching.
Tests These are optional new params, so I've not added specific test cases.