Prioritization capability: handle non-token limited endpoints

Azure-Samples / apim-genai-gateway-toolkit

A repo to accelerate development and testing of GenAI Gateways built with Azure API Management. Includes various capabilities as examples/starters.

MIT License

39 stars 14 forks source link

Open stuartleeks opened 4 weeks ago

stuartleeks commented 4 weeks ago

[ ] Ensure that both the prioritization implementations handle non-token limited endpoints such as DALL-E
[ ] Add load tests to validate/demonstrate non-token handling