Josh-XT
commented
12 months ago Hello @pegas07770 ! If you're running from options 1-3 in the AGiXT installer, localhost would be the incorrect destination for your Kobold instance. You will need to use your local IP for the computer it is hosted on. Keep in mind that in docker, your local machine is not the localhost, it is like a machine within your machine and will have to communicate with your machine over the network by your IP that should be something similar to 192.168.1.xxx.
AliveDedSec
Description
I carefully watched the video https://www.youtube.com/watch?v=XbjjPdYRM_k But the agent I created cannot chat in the AGiXT v1.3.122 Latest. Agent Interactions tab. I configured everything as in the video, I practically did not change the agent settings. I have tried different variations of AI_PROVIDER_URI (http://localhost:5050/api/v1 http://localhost:5050/api http://localhost:5050). All AI_PROVIDER_URI variants always corresponded to active Kobold.cpp servers with a running LLM model. The generation in Kobold.cpp and SillyTavern-1.9.7 has always been successful. I have tried almost every possible setting for the Agent and Kobold.cpp. I changed the Kobold.cpp server to other ports. But all to no avail. Always the same error. Here is one variation of this error with AI_PROVIDER_URI http://localhost:5050/api/v1
Steps to Reproduce the Bug
1) Running Kobold.cpp with different LLM models 2) Checking the generation of texts LLM models в Kobold.cpp 3)Configuring the AGiXT Agent (AI_PROVIDER_URI, provider, and so on) 4) Attempt to chat with an agent on the Agent Interactions tab
Expected Behavior
Agent work with Kobold.cpp
Operating System
Python Version
Environment Type - Connection
Runtime environment
Acknowledgements