-
### Issue
It would be great if you could set the anthropic API base (similar to the openai api base).
This would allow you to use Anthropic models hosted on Bedrock via an API key rather than havi…
-
### 📦 Deployment Method
Docker
### 📌 Version
v2.13
### 💻 Operating System
Other Linux
### 📌 System Version
debian 11
### 🌐 Browser
Chrome
### 📌 Browser Version
126
### 🐛 Bug Description
最…
-
### The Feature
```
curl --location 'http://0.0.0.0:4000/chat/completions' \
--header 'Content-Type: application/json' \
--data '{
"model": "gpt-4o",
"metadata": {
"guardrails": {"promp…
-
I am trying to use small summarizer as a tool for my task.
But at the > Entering new CrewAgentExecutor chain...
I am getting provided error 8 of 10 times (which is also weird):
```
Traceback (…
-
如題,在 issue #545 中,有用戶提及需要API進行操作
目前僅能夠從程式中解析API功能,難以整理成腳本進行直連
由於我目前是使用openai官方提供的api進行gpt-4o的模型互動
因此並沒有Ollama可以直接進行程式上的操作
想詢問是否有相關的API能夠直接開出來讓服務外能夠直接連接
-
Pick 5 real smart contracts with less than 4096 tokens and reverse an "average" prompt out of them with a prompt similar to the used to generate the dataset:
> Create a prompt for an average user wit…
-
## 🚀 Feature Request
Now pne cannot use stream + output_schema. For example:
```python
import pne
from pydantic import BaseModel
class LLMResponse(BaseModel):
content: str = Field(...,…
-
GPT4o is out now and better then GPT4 Turbo it's also not more expensive then gpt4 turbo, so this script schould be updated to use gpt4o instead of gpt4 turbo (don't know if anything in the API change…
-
The rpm value set in the command is not honoured and we get inconsistent rpm from the benchmarking tool using --rate paramater. eg, if we set --rate 10, we get RPM of over 20 as well.
python -m ben…
-
how to set GPT-4o as default module and output voice?