search

kwaroran / RisuAI

Make your own story. User-friendly software for LLM roleplaying
https://risuai.net
GNU General Public License v3.0
797 stars 141 forks source link

Bug: Ollama source stream issue #587

Open LoopControl opened 3 months ago

LoopControl commented 3 months ago

When using Ollama (url http://localhost:11434), the response only shows the last streamed chunk/token/word.

It looks like it's replacing the response message with the last streamed token/chunk instead of appending to the previously streamed chunks/tokens.

This is on latest master (commit 952ee5f) checked out a few minutes ago.

diegocostares commented 3 months ago

The exact same thing happens to me @kwaroran plss

https://github.com/user-attachments/assets/a50dda78-f7fb-4f96-a6c3-315e3afbdcde

diegocostares commented 3 months ago

Check if it worked before and the same problem occurs in version v123.0.0

Tom-Neverwinter commented 3 months ago

so its not just me. https://github.com/kwaroran/RisuAI/issues/582 seems like a lot of the api are broken

razvanab commented 3 months ago

Same here with ollama.

razvanab commented 2 weeks ago

Can you please fix this ?

orsonteodoro commented 1 day ago

The fix can be found at https://github.com/orsonteodoro/oiledmachine-overlay/blob/master/games-rpg/RisuAI/files/RisuAI-139.2.0-ollama-fix.patch

There is another issue when I ran into the above issue that the AI may do an infinite loop and repeat the same phrases over and over and there is no word limit or time limit.