Incorrect token calculation for temp-api-key based on JWT token

epam / ai-dial-core

The main component of AI DIAL, which provides unified API to different chat completion and embedding models, assistants, and applications

https://epam-rail.com

Apache License 2.0

339 stars 18 forks source link

Closed vladisavvv closed 2 months ago

vladisavvv commented 2 months ago

Case:

I have DIAL application
Send request to it with Authorization header via our core API
Application send request to the model and fails because of token limits, but my user (owner of JWT) didn't use the application on this day.