ParisNeo / lollms-webui

Lord of Large Language Models Web User Interface
https://parisneo.github.io/lollms-webui/
Apache License 2.0
4.11k stars 522 forks source link

stuck on Warming up #474

Closed de-lac2 closed 6 months ago

de-lac2 commented 6 months ago

Expected Behavior

AI should response after user's text input. It worked for a while, then now it doesn't work anymore. Tried to delete everything and install everything back from scratch, python included.

Current Behavior

no response back from system. just " warming up ..."

Steps to Reproduce

Please provide detailed steps to reproduce the issue.

  1. User write something, like "ciao"
  2. just wait... on the UI chat, there is just "warming up..."
  3. on the console, I see
INFO:     ::1:50534 - "GET /get_generation_status HTTP/1.1" 200 OK
Starting message generation by lollms
Text generation requested by client: 6evnP_Mxv8L8I38YAAAJ
Received message : ciao
Started generation task
INFO:     ::1:50534 - "GET /user_infos/default_user.svg HTTP/1.1" 404 Not Found
warmup for generating up to 4022 tokens
INFO:     ::1:50534 - "GET /assets/Roboto-Regular-7277cfb8.ttf HTTP/1.1" 304 Not Modified

Possible Solution


Context

MacBook Pro M3max

building zoo: Ollama Model zoo: llama-2

pip --version
pip 23.3.2 from /Users/danielefani/Documents/AI/.venv/lib/python3.11/site-packages/pip (python 3.11)

python --version
Python 3.11.7

Screenshots

--

de-lac2 commented 6 months ago

I don't know how it's related, but restarting the app Ollama (on the Mac, there is a separated desktop app Ollama I installed), it started working again