zylon-ai / private-gpt

Interact with your documents using the power of GPT, 100% privately, no data leaks
https://privategpt.dev
Apache License 2.0
54.09k stars 7.27k forks source link

Incomplete response #836

Closed ChrisBNECBT closed 9 months ago

ChrisBNECBT commented 1 year ago

The response of a query is incomplete. ChatGPT3.5 allows users to prompt it to continue with the response in a new prompt and the team at Oobabooga added a "Continue" button to their WebUI to do the same.

There is no way to continue lost response currently through a new prompt and splitting the prompts into smaller chunks resulted in a lost of context when responding.

I'm unsure whether this is a bug or missing feature and am wondering is there a fix to allow a full response.

I'm new to this. Screenshot 2023-07-09 at 08-47-17 ChatDocs

Eng-AliKazemi commented 1 year ago

I have the same issue (I'm testing):

Prompt: write a long story about Ukraine

Answer (took 81.44 s.):

Ukraine is a country located in Eastern Europe, bordering Russia to the east and northeast, Belarus to the northwest, Poland and Slovakia to the west, Hungary, Romania, and Moldova to the south. The capital city of Ukraine is Kiev, which is also its largest city with over 2 million people living there. Ukraine has a rich history dating back to ancient times when it was inhabited by various tribes such as the Scythians and Cimmerians. In the Middle Ages, it became part of the Kingdom of Galicia-Volhynia before being conquered by the Mongols in 1240. Later on, it came under the rule of Lithuania and Poland until it was annexed by Russia during the partitions of Poland in the late 18th century. During World War II, Ukraine suffered greatly with over 6 million Ukrainians losing their lives due to famine caused by Soviet policies known as the Holodomor. After the war ended, Ukraine became a part of the Soviet Union until its collapse in 1991. Since then, it has been an independent country but continues to face challeng

Enter a query:

remyderuysscher commented 10 months ago

I second this, might be a technical issue such as time contraint or memory limitations? How can I investigate this?