CNSeniorious000 / free-chat

An elegant LLM chat UI forked from chatgpt-demo of @anse-app. Index site at https://free-chat.asia
https://endless-chat.vercel.app
MIT License
178 stars 51 forks source link

咨询一下部署 #3

Open wisfern opened 1 year ago

wisfern commented 1 year ago

老哥,虚心请教一下,你的网站是怎么部署的,我在日本节点部署了一下,也没这么快的速度。

CNSeniorious000 commented 1 year ago

你说的是产生词的速度吗?那跟部署关系不大,是openai对未绑卡用户的限制。具体见官方文档

We enforce rate limits at the organization level, not user level, based on the specific endpoint used as well as the type of account you have. Rate limits are measured in two ways: RPM (requests per minute) and TPM (tokens per minute). CHAT
Free trial users 3 RPM 40,000 TPM
Pay-as-you-go users (first 48 hours) 60 RPM 60,000 TPM
Pay-as-you-go users (after 48 hours) 3,500 RPM 90,000 TPM

我部署得比较复杂,我是用Vercel和Netlify请求openai,然后我阿里云的国内的服务器挂日本的代理去请求它,而我的网站是直接连到腾讯云的CDN服务

lxmicode commented 1 year ago

image 目前:变量只设置openAI_key 请问下是什么问题,是服务器网络不知道openAI吗

CNSeniorious000 commented 1 year ago

键名应该是 OPENAI_API_KEY

lxmicode commented 1 year ago

不好意思打的随意了,键名没错,就设置了一个,但是效果就如上面图片了 image

CNSeniorious000 commented 1 year ago

你这个图是vim编辑没退出吧

lxmicode commented 1 year ago

我的图片意思是,我环境配置了,只配置了一个OPENAI_API_KEY,会出现下面的错误。 image

CNSeniorious000 commented 1 year ago

你看那报错 就是说没有找到这个环境变量。

如果你确定你一定是配对了的 那你是不是没有重新build

lxmicode commented 1 year ago

这边采用了docker方式部署,arm镜像, 在 /root/app/ddiu8081_chatgpt/.env 下添加 OPENAI_API_KEY 变量, 启动后页面操作出现上面的图片错误

如下配置:

version: '3'

services: chatgpt-demo: image: ddiu8081/chatgpt-demo:latest container_name: chatgpt-demo restart: always ports: