stuartleeks / aoai-simulated-api

An exploration into creating a simulated API implementation for Azure OpenAI (AOAI)
MIT License
11 stars 4 forks source link

Update generator support for embeddings (vary with model and support dimension request parameter) #30

Open stuartleeks opened 3 months ago

stuartleeks commented 3 months ago

The response length varies between the models. By default, text-embedding-3-small uses 1536 and text-embedding-3-large uses 3072 (see https://platform.openai.com/docs/guides/embeddings/how-to-get-embeddings)

Additionally, the text-embedding-3 and later models support a dimension property on the request.