search

OthersideAI / self-operating-computer

A framework to enable multimodal models to operate a computer.
https://www.hyperwriteai.com/self-operating-computer
MIT License
8.86k stars 1.19k forks source link

[BUG] operate -m llava return error local variable 'content' referenced before assignment #176

Open chungy123 opened 8 months ago

chungy123 commented 8 months ago

I am using linux with ollama. After ollama pull llava and ollama serve, operate -m llava return error local variable 'content' referenced before assignment

Steps to Reproduce

  1. Alternatively installation with .sh
  2. ollama pull llava
  3. ollama pull llava
  4. operate -m llava
  5. Input prompt

Expected Behavior

Perform the action of the prompt

Actual Behavior:

return [llava] That did not work. Trying again X get_image failed: error 8 (73, 0, 680) [Self-Operating Computer][Error] -> local variable 'content' referenced before assignment

Environment

Screenshots

image

mahmudremal commented 3 months ago

Is this problem solved?

glgslsj commented 2 months ago

i have the same problem

cybersholt commented 2 months ago

image I get the same error on Windows 11 adding the verbose flag seems that it fails generating the action like seen in the image and there's never a request sent to Ollama.

Tried a python script to test the connection to Ollama and it's fine.

--EDIT--

Turned out to be an environment variable, make sure your OLLAMA_HOST is set correctly.