issues
search
stuartleeks
/
aoai-simulated-api
An exploration into creating a simulated API implementation for Azure OpenAI (AOAI)
MIT License
9
stars
4
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Add support for image generation endpoint
#48
stuartleeks
opened
1 week ago
0
Add support for translation endpoint
#47
stuartleeks
opened
1 week ago
0
Add support for transcription endpoint
#46
stuartleeks
opened
1 week ago
0
Align streaming response with OpenAI API and remove double latency
#45
stuartleeks
opened
1 week ago
0
Add per-minute rate limits
#44
stuartleeks
closed
3 weeks ago
0
Embedding Size updates
#43
stuartleeks
closed
3 weeks ago
0
Add overview to main README and move run/deploy to separate file
#42
stuartleeks
closed
3 weeks ago
0
Add scripted load tests
#41
stuartleeks
closed
3 weeks ago
0
Initial docs for developing simulator
#40
stuartleeks
closed
3 weeks ago
1
PR: Update generator support for embeddings (vary with model and support dimension request parameter)
#39
MDUYN
closed
4 weeks ago
0
Add shellcheck extension
#38
stuartleeks
closed
1 month ago
0
Add ALLOW_UNDEFINED_OPENAI_DEPLOYMENTS config option
#37
stuartleeks
closed
1 month ago
0
Initial docs refactor
#36
stuartleeks
closed
1 month ago
0
Add configuration options to control size of generated response
#35
stuartleeks
opened
1 month ago
0
Bug: completion_tokens sometimes exceeds specified max_tokens
#34
stuartleeks
closed
1 month ago
0
Minor tweaks/fixes
#33
stuartleeks
closed
1 month ago
0
Extensibility refactoring
#32
stuartleeks
closed
1 month ago
0
Add PAYG behaviour for rate-limiting
#31
stuartleeks
opened
2 months ago
0
Update generator support for embeddings (vary with model and support dimension request parameter)
#30
stuartleeks
opened
2 months ago
0
Ensure url path is included when outputting error for no matching handler
#29
stuartleeks
closed
2 months ago
0
Add config endpoint
#28
stuartleeks
closed
2 months ago
0
Add Generator latency for OpenAI endpoints
#27
stuartleeks
closed
2 months ago
0
Feature: Build ghcr package
#26
bart-jansen
closed
2 months ago
1
Feature: Add auth bearer token support
#25
bart-jansen
closed
1 month ago
2
Rework config and extensibility points
#24
stuartleeks
closed
3 months ago
0
Simulator restricted network support for tiktoken
#23
aerjenn
closed
3 months ago
2
Switch to fixed window limiter
#22
stuartleeks
closed
3 months ago
0
Remove FastAPIInstrumentor
#21
stuartleeks
closed
3 months ago
0
Perf issue: Enabling rate-limiting increases latency
#20
stuartleeks
opened
3 months ago
2
Perf issue: Enabling telemetry increases request latency
#19
stuartleeks
closed
3 months ago
2
Add Metrics and extend load tests
#18
stuartleeks
closed
3 months ago
0
Finish rate-limiting implementation for OpenAI
#17
stuartleeks
opened
3 months ago
0
Enable record/replay for streaming requests
#16
stuartleeks
opened
3 months ago
0
Determine the number of tokens to use in generated chat completion responses
#15
stuartleeks
opened
3 months ago
1
Add deployment to ACA via bicep
#14
stuartleeks
closed
3 months ago
0
Address linter feedback
#13
stuartleeks
closed
3 months ago
0
Added tiktoken cache support, added script to load encoding file
#12
aerjenn
closed
3 months ago
2
Add tests
#11
stuartleeks
closed
3 months ago
0
Added tiktoken cached file for restricted network scenario
#10
aerjenn
closed
3 months ago
0
Update extensibility
#9
stuartleeks
closed
3 months ago
0
Allow loading directories for extensibility as well as single files
#8
stuartleeks
closed
3 months ago
0
Extensibility - allow typed references rather than `dict`s
#7
stuartleeks
closed
3 months ago
0
Add testing
#6
stuartleeks
closed
3 weeks ago
2
Improve extensibility
#5
stuartleeks
closed
1 month ago
1
Include duration in recording and use to simulate latency
#4
stuartleeks
closed
3 months ago
0
Add ability to record latency for individual requests
#3
hannesne
closed
3 months ago
0
Document Intelligence - generate dynamic response
#2
mcollier
closed
5 months ago
0
Switch to RecordReplayHandler
#1
stuartleeks
closed
5 months ago
0