search

ItsPi3141 / alpaca-electron

The simplest way to run Alpaca (and other LLaMA-based local LLMs) on your own computer
MIT License
1.29k stars 144 forks source link

When clear chat is pressed two times, subsequent requests don't generate anything #25

Open VictorZakharov opened 1 year ago

VictorZakharov commented 1 year ago

Describe the bug When clear chat is pressed two times, subsequent requests don't generate anything.

To Reproduce Steps to reproduce the behavior:

  1. Ask something. Wait for bot to answer. Observe CPU is around 70%. I have a Ryzen 9 5900x.
  2. Press clear chat twice.
  3. Ask something else.
  4. Nothing happens, CPU is idle.

Expected behavior Should be able to continue in a new conversation without having to end process in Task Manager every time.

Screenshots N/A

Desktop (please complete the following information):

Additional context Using Alpaca 13B native model linked from the Releases page. I tried the above workflow two times with the same problem before posting this issue.

ItsPi3141 commented 1 year ago

Yes that's a known issue with llama.cpp itself. I will try to implement a temporary fix for it soon.