search

pieces-app / support

16 stars 3 forks source link

Response is not complete #239

Open bardo84 opened 3 months ago

bardo84 commented 3 months ago

Software

Desktop Application

Operating System / Platform

Windows

Your Pieces OS Version

2.12.2

Early Access Program

Kindly describe the bug and include as much detail as possible on what you were doing so we can reproduce the bug.

Apparently not specific for Pieces, happens with ChatGPT, but also local Phi-2. Long answers are not completed. Can stop in the middle of a phrase or code block.

brian-pieces commented 3 months ago

@bardo84 sorry to hear your having this problem. @mark-at-pieces might be better suited to respond to the GPT issue, but, for Phi-2, this issue is due to a limited context window size implemented by us to keep your RAM usage down. Unfortunately, when this context length is reached, the output will abruptly be stopped. We're actively working on a update that will not only increase this context length, but also adds new models like Llama 3, Phi 3, and Gemma. We're hoping to have this update out in the coming weeks!