search

koishijs / chatgpt-bot

AI conversation based on ChatGPT | 基于 ChatGPT 的 AI 对话机器人
https://chatgpt.koishi.chat
MIT License
70 stars 13 forks source link

Feat: Use a local GPT2 model as a fallback. #29

Open lychees opened 1 year ago

lychees commented 1 year ago

OpenAI is currently facing tremendous traffic, making the ChatGPT service often unavailable. There are other NLP model, e.g. GPT2 which is open-source and easy to get via the internet, can we add a fallback function so that when the connection is broken, the bot can still responding to user's input.

MaikoTan commented 1 year ago

I don't think this is a good solution. This would not only break our conversation context maintaining state, but also makes the conversation unstable (as you see the GPT2 model you mentioned always behaves bad compare to ChatGPT).