Closed Yazorp closed 7 months ago
Hmm, it's meant to be a timeout if the request is taking too long..I guess I can just remove it instead if it's causing issues. I remove it in 3.7.15
as it was logic from the old stream code and probably not needed.
Describe the bug The current hard coded setting of
export const COMPLETION_TIMEOUT = 20000 // 20 seconds
is causing chat generations such as "Explain" to stop early even though the token limit hasn't been reached.Suggest either making this at least 2 minutes at 120000 or adding a configurable settings entry.