search

stuartleeks / aoai-simulated-api

An exploration into creating a simulated API implementation for Azure OpenAI (AOAI)
MIT License
11 stars 4 forks source link

Add ability to record latency for individual requests #3

Closed hannesne closed 5 months ago

hannesne commented 5 months ago

Record the latency that a request had, and use that in replay mode. Latency should be an optional item.