KenyonY / openai-forward

🚀 大语言模型高效转发服务 · An efficient forwarding service designed for LLMs. · OpenAI API Reverse Proxy
https://api.openai-forward.com
MIT License
839 stars 288 forks source link

429 Too Many Requests #113

Closed ZeguanXiao closed 9 months ago

ZeguanXiao commented 9 months ago

初始检查

问题描述

即使没有程序在使用openai api,程序log仍然出现大量的 429 Too Many Requests 。

截屏2024-02-01 13 53 05

配置/代码示例和输出

LOG_CHAT=false

CACHE_CHAT_COMPLETION=false

CACHE_BACKEND=LevelDB

OPENAI_BASE_URL='https://api.openai.com/v1' OPENAI_ROUTE_PREFIX='/v1'

CHAT_COMPLETION_ROUTE=/chat/completions COMPLETION_ROUTE=/completions

EXTRA_BASE_URL='http://chatgpt:7999' EXTRA_ROUTE_PREFIX='/'

OPENAI_API_KEY=

FORWARD_KEY=

PROXY http代理

PROXY=http://localhost:6292 PROXY=http://[占位符]@localhost:6292

TCP connection timeout duration (in seconds)

TIMEOUT=120

Set timezone

TZ=Asia/Shanghai

我的见解

No response

环境

python: 3.10.13 (main, Sep 11 2023, 13:44:35) [GCC 11.2.0] OS: Linux openai_forward: 0.7.1

最后一步

KenyonY commented 9 months ago

Hi @ZeguanXiao 看到你使用的配置仍然是旧版的,那已经过时了,建议参考最新.env文件更新相关配置。