OthersideAI / self-operating-computer

A framework to enable multimodal models to operate a computer.
https://www.hyperwriteai.com/self-operating-computer
MIT License
8.21k stars 1.09k forks source link

[BUG] operate -m llava return error local variable 'content' referenced before assignment #176

Open chungy123 opened 4 months ago

chungy123 commented 4 months ago

I am using linux with ollama. After ollama pull llava and ollama serve, operate -m llava return error local variable 'content' referenced before assignment

Steps to Reproduce

  1. Alternatively installation with .sh
  2. ollama pull llava
  3. ollama pull llava
  4. operate -m llava
  5. Input prompt

Expected Behavior

Perform the action of the prompt

Actual Behavior:

return [llava] That did not work. Trying again X get_image failed: error 8 (73, 0, 680) [Self-Operating Computer][Error] -> local variable 'content' referenced before assignment

Environment

Screenshots

image