Closed x-legion closed 1 year ago
In addition it only shows streaming text when you are not using the Aestethic Text UI.
In addition it only shows streaming text when you are not using the Aestethic Text UI.
exactly.
put streaming in the url, e.g. http://localhost:5001?streaming=1 and it should work.
but it doesnt work on aesthetic chat ui
Yes, currently streaming does not work in the aesthetic chat UI... it may be added in future but is not a high priority for now.
@LostRuins By the way, I haven't checked since last time, but do you know if streaming is possible through sillytavern? I think oobabooga works with streaming, not sure about koboldcpp though.
It depends on how they implemented streaming. The Kobold API emulates it by breaking it up into small requests - this is not true streaming which is not implemented.
True streaming is now available in newest versions.
put streaming in the url, e.g. http://localhost:5001?streaming=1 and it should work.