search

frdel / agent-zero

Agent Zero AI framework
Other
4.72k stars 1.04k forks source link

JSON Formatting Issue #85

Closed aheywood89 closed 1 month ago

aheywood89 commented 2 months ago

Hi, no matter what I ask in the prompt, I get the following error: "system_warning": "You have misformatted your message. Follow system prompt instructions on JSON message formatting precisely." I have even attempted to get the agent to try to correct this but it sends it off in a tangent.

livef01 commented 2 months ago

When using Agent Zero with models like LLaMA 3.1:8B and LLaMA 3.1:70B, you may encounter the same error. However, OpenRouter, which is currently hosting a free Hermes-3-LLaMA-3.1-405B model, seems to handle function calls more effectively, similar to ChatGPT models. I recommend trying that model, as I’ve noticed the error occurs less frequently.

frdel commented 1 month ago

Ollama context window fix is planned for next version, this improves llama3.1 8B performance.