-
When using the plugin to translate text the `GenerateController::actionIndex()` returns the following. Would just sending and waiting for the request suffice instead of streaming it? It'd remove some …
-
### Feature Description
OpenAI has added support for structured outputs in its API: https://openai.com/index/introducing-structured-outputs-in-the-api/
Ultimately, this means the existing ChatRe…
-
-
-
# Hybrid search
- [ ] one basic test with every embedder
- [x] user provided
- [x] Hugging Face
- [x] OpenAI
- [x] basic test
- [x] search with wrong API key
- [x] search wi…
-
Add LLM inference support for https://lmstudio.ai/
Implementation notes:
- Use appropriate SDK: https://github.com/lmstudio-ai/lmstudio.js
- Target directory: `src/adapters/lmstudio` with files `…
-
### Your current environment
The startup command is as follows: it initiates both a standard 7B model and an n-gram speculate model. Speed tests discover that the speculate model performs more slowl…
-
Can I use an Azure Open AI Endpoint with this? Any particular way to structure the endpoint?
I.e.
```"gptcommit.openAI.customEndpoint": "https://.openai.azure.com```
or
```"gptcommit.openA…
-
### API Spec link
https://github.com/Azure/azure-rest-api-specs/blob/main/specification/cognitiveservices/data-plane/AzureOpenAI/inference/preview/2024-09-01-preview/inference.json
### API Spec vers…
-
**Is your feature request related to a problem? Please describe.**
I have access to `o1-preview` models on azure, but cannot use them with `openai` and `@azure/openai/types`.
**Describe the soluti…