search

mayooear / gpt4-pdf-chatbot-langchain

GPT4 & LangChain Chatbot for large PDF docs
https://www.youtube.com/watch?v=ih9PBGVVOO4
14.95k stars 3.02k forks source link

chatbot response does not mimick ChatGPT incremental text generation style #272

Closed Marwan567 closed 1 year ago

Marwan567 commented 1 year ago

Hi,

When i ask the chatbot a question it will just say "waiting for response" and then provide the whole response straight away rather than provide the response in an incremental text generation style similar to the actual chatGPT and also as was shown in the video tutorial.

Any way i could get it to respond in that style please?

dissorial commented 1 year ago

That's a whole feature on its own to be implemented. It's not just a matter of styling. Unlikely to be added any time soon I think.

groovybits commented 1 year ago

I have it working and the newest 104 version of langchain too...

https://github.com/groovybits/gaib

I have also just made changes so it runs without all the API keys that are extra / specific to using services I added other than OpenAI and Pinecone. It's as of last night so I will be fixing any bugs and would love to make it fully work in the "normal chatbot" mode of this project i forked it from. I am planning on adding that "Theme" back in the next few days. I have "Themes" like terminal mode and a mode to not stream but view as a episode w/subtitles and speaking with images to match. That is all going to be "extra features" and the base chatbot behavior will be back very soon!

dosubot[bot] commented 1 year ago

Hi, @Marwan567! I'm Dosu, and I'm helping the gpt4-pdf-chatbot-langchain team manage their backlog. I wanted to let you know that we are marking this issue as stale.

From what I understand, you opened this issue because the chatbot response does not mimic the incremental text generation style of ChatGPT. Dissorial mentioned that implementing this feature is unlikely in the near future. However, groovybits commented that they have it working in their forked version of the project and plan to add it back as a "normal chatbot" mode soon. They also mentioned adding extra features like terminal mode and episode viewing with subtitles and images.

Before we close this issue, we wanted to check with you if it is still relevant to the latest version of the gpt4-pdf-chatbot-langchain repository. If it is, please let us know by commenting on the issue. Otherwise, feel free to close the issue yourself, or it will be automatically closed in 7 days.

Thank you for your contribution to the project!