Azure-Samples / openai-aca-lb

Smart load balancing for Azure OpenAI endpoints
MIT License
40 stars 17 forks source link

Reuse the Azure token if it has not expired. #24

Open sudhinsr opened 2 months ago

sudhinsr commented 2 months ago

Purpose

Does this introduce a breaking change?

[ ] Yes
[x] No

Pull Request Type

What kind of change does this Pull Request introduce?

[ ] Bugfix
[x] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[ ] Other... Please describe:

How to Test

git clone [repo-address]
cd [repo-name]
git checkout [branch-name]
npm install

What to Check

Verify that the following are valid

Other Information

sudhinsr commented 2 months ago

@microsoft-github-policy-service agree