Closed AliveDedSec closed 12 months ago
Hello @pegas07770 ! If you're running from options 1-3 in the AGiXT installer, localhost
would be the incorrect destination for your Kobold instance. You will need to use your local IP for the computer it is hosted on. Keep in mind that in docker, your local machine is not the localhost
, it is like a machine within your machine and will have to communicate with your machine over the network by your IP that should be something similar to 192.168.1.xxx
.
Hey @pegas07770! If you are using options 1-3 in the AGiXT installer,
localhost
will not be the correct destination for your Kobold instance. You will need to use your local IP address for the computer hosting it. Keep in mind that in docker, your local machine is notlocalhost
, it is like a machine inside your machine, and it will have to communicate with your machine over the network at your IP address, which should be something like192.168. 1.xxx
.
I absolutely understand what you are talking about. I'm not an amateur. Here is the full log of the AGiXT window and Kobold.cpp currently running for me. All the same.
***
Welcome to KoboldCpp - Version 1.40.1
For command line arguments, please refer to --help
***
Setting process to Higher Priority - Use Caution
High Priority for Linux Set: 0 to 1
Attempting to use CuBLAS library for faster prompt ingestion. A compatible CuBLAS will be required.
Initializing dynamic library: koboldcpp_cublas.so
==========
Namespace(model=None, model_param='/home/agi/stablebeluga-7b.ggmlv3.q4_0.bin', port=5001, port_param=8000, host='127.0.0.1', launch=False, lora=None, threads=4, blasthreads=4, psutil_set_threads=False, highpriority=True, contextsize=4096, blasbatchsize=512, ropeconfig=[0.0, 10000.0], stream=True, smartcontext=True, unbantokens=False, bantokens=None, usemirostat=None, forceversion=0, nommap=False, usemlock=False, noavx2=False, debugmode=False, skiplauncher=False, hordeconfig=None, noblas=False, useclblast=None, usecublas=['lowvram', 'mmq'], gpulayers=25, tensor_split=None)
==========
Loading model: /home/agi/stablebeluga-7b.ggmlv3.q4_0.bin
[Threads: 4, BlasThreads: 4, SmartContext: True]
---
Identified as LLAMA model: (ver 5)
Attempting to Load...
---
Using automatic RoPE scaling (scale:1.000, base:32000.0)
System Info: AVX = 1 | AVX2 = 0 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | FMA = 0 | NEON = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 1 | VSX = 0 |
llama.cpp: loading model from /home/agi/stablebeluga-7b.ggmlv3.q4_0.bin
llama_model_load_internal: format = ggjt v3 (latest)
llama_model_load_internal: n_vocab = 32000
llama_model_load_internal: n_ctx = 4096
llama_model_load_internal: n_embd = 4096
llama_model_load_internal: n_mult = 5504
llama_model_load_internal: n_head = 32
llama_model_load_internal: n_head_kv = 32
llama_model_load_internal: n_layer = 32
llama_model_load_internal: n_rot = 128
llama_model_load_internal: n_gqa = 1
llama_model_load_internal: rnorm_eps = 5.0e-06
llama_model_load_internal: n_ff = 11008
llama_model_load_internal: freq_base = 32000.0
llama_model_load_internal: freq_scale = 1
llama_model_load_internal: ftype = 2 (mostly Q4_0)
llama_model_load_internal: model size = 7B
llama_model_load_internal: ggml ctx size = 0.08 MB
ggml_init_cublas: found 1 CUDA devices:
Device 0: NVIDIA GeForce GTX 1050 Ti, compute capability***
Welcome to KoboldCpp - Version 1.40.1
For command line arguments, please refer to --help
***
Setting process to Higher Priority - Use Caution
High Priority for Linux Set: 0 to 1
Attempting to use CuBLAS library for faster prompt ingestion. A compatible CuBLAS will be required.
Initializing dynamic library: koboldcpp_cublas.so
==========
Namespace(model=None, model_param='/home/agi/stablebeluga-7b.ggmlv3.q4_0.bin', port=5001, port_param=8000, host='127.0.0.1', launch=False, lora=None, threads=4, blasthreads=4, psutil_set_threads=False, highpriority=True, contextsize=4096, blasbatchsize=512, ropeconfig=[0.0, 10000.0], stream=True, smartcontext=True, unbantokens=False, bantokens=None, usemirostat=None, forceversion=0, nommap=False, usemlock=False, noavx2=False, debugmode=False, skiplauncher=False, hordeconfig=None, noblas=False, useclblast=None, usecublas=['lowvram', 'mmq'], gpulayers=25, tensor_split=None)
==========
Loading model: /home/agi/stablebeluga-7b.ggmlv3.q4_0.bin
[Threads: 4, BlasThreads: 4, SmartContext: True]
---
Identified as LLAMA model: (ver 5)
Attempting to Load...
---
Using automatic RoPE scaling (scale:1.000, base:32000.0)
System Info: AVX = 1 | AVX2 = 0 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | FMA = 0 | NEON = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 1 | VSX = 0 |
llama.cpp: loading model from /home/agi/stablebeluga-7b.ggmlv3.q4_0.bin
llama_model_load_internal: format = ggjt v3 (latest)
llama_model_load_internal: n_vocab = 32000
llama_model_load_internal: n_ctx = 4096
llama_model_load_internal: n_embd = 4096
llama_model_load_internal: n_mult = 5504
llama_model_load_internal: n_head = 32
llama_model_load_internal: n_head_kv = 32
llama_model_load_internal: n_layer = 32
llama_model_load_internal: n_rot = 128
llama_model_load_internal: n_gqa = 1
llama_model_load_internal: rnorm_eps = 5.0e-06
llama_model_load_internal: n_ff = 11008
llama_model_load_internal: freq_base = 32000.0
llama_model_load_internal: freq_scale = 1
llama_model_load_internal: ftype = 2 (mostly Q4_0)
llama_model_load_internal: model size = 7B
llama_model_load_internal: ggml ctx size = 0.08 MB
ggml_init_cublas: found 1 CUDA devices:
Device 0: NVIDIA GeForce GTX 1050 Ti, compute capability 6.1
llama_model_load_internal: using CUDA for GPU acceleration
llama_model_load_internal: mem required = 1597.11 MB (+ 2048.00 MB per state)
llama_model_load_internal: not allocating a VRAM scratch buffer due to low VRAM option
llama_model_load_internal: offloading 25 repeating layers to GPU
llama_model_load_internal: offloaded 25/35 layers to GPU
llama_model_load_internal: total VRAM used: 2715 MB
llama_new_context_with_model: kv self size = 2048.00 MB
Load Model OK: True
Embedded Kobold Lite loaded.
Starting Kobold HTTP Server on port 8000
Please connect to custom endpoint at http://127.0.0.1:8000 6.1
llama_model_load_internal: using CUDA for GPU acceleration
llama_model_load_internal: mem required = 1597.11 MB (+ 2048.00 MB per state)
llama_model_load_internal: not allocating a VRAM scratch buffer due to low VRAM option
llama_model_load_internal: offloading 25 repeating layers to GPU
llama_model_load_internal: offloaded 25/35 layers to GPU
llama_model_load_internal: total VRAM used: 2715 MB
llama_new_context_with_model: kv self size = 2048.00 MB
Load Model OK: True
Embedded Kobold Lite loaded.
Starting Kobold HTTP Server on port 8000
Please connect to custom endpoint at http://127.0.0.1:8000
___ _______ _ ________
/ | / ____(_) |/ /_ __/
/ /| |/ / __/ /| / / /
/ ___ / /_/ / // | / /
/_/ |_\____/_//_/|_|/_/
----------------------------------------------------
Visit our documentation at https://AGiXT.com
Welcome to the AGiXT Installer!
Please choose an option:
1. Run AGiXT (Recommended)
2. Run AGiXT with Text Generation Web UI (NVIDIA Only)
Developer Only Options (Not recommended or supported):
3. Run AGiXT with Docker from Main Branch
4. Run AGiXT on local machine
Manage:
5. Update AGiXT
6. Wipe AGiXT Hub (Irreversible)
7. Exit
Enter your choice: 1
Running Updates...
Updating AGiXT Core...
fatal: не найден git репозиторий (или один из родительских каталогов): .git
Уже актуально.
Current directory: /home/agi/AGiXT-1.3.112
[+] Pulling 2/2
✔ streamlit Pulled 5.5s
✔ agixt Pulled 5.7s
Updates Completed...
Update complete.
Starting Docker Compose...
WARN[0000] Found orphan containers ([agixt-13112-text-generation-webui-1]) for this project. If you removed or renamed this service in your compose file, you can run this command with the --remove-orphans flag to clean it up.
[+] Running 2/0
✔ Container agixt-13112-agixt-1 C... 0.0s
✔ Container agixt-13112-streamlit-1 Created 0.0s
Attaching to agixt-13112-agixt-1, agixt-13112-streamlit-1
agixt-13112-agixt-1 | Loading environment variables from .env file in parent directory...
agixt-13112-streamlit-1 |
agixt-13112-streamlit-1 | You can now view your Streamlit app in your browser.
agixt-13112-streamlit-1 |
agixt-13112-streamlit-1 | Network URL: http://172.20.0.3:8501
agixt-13112-streamlit-1 | External URL:
agixt-13112-streamlit-1 | http://185.195.71.244:8501
agixt-13112-streamlit-1 |
agixt-13112-streamlit-1 |
agixt-13112-agixt-1 | No changes detected in the AGiXT Hub at AGiXT/hub, moving on...
agixt-13112-agixt-1 | Starting AGiXT... Please wait until you see 'Applicaton startup complete' before opening Streamlit...
agixt-13112-agixt-1 | INFO: Uvicorn running on http://0.0.0.0:7437 (Press CTRL+C to quit)
agixt-13112-agixt-1 | INFO: Started parent process [11]
agixt-13112-agixt-1 | INFO: Started server process [15]
agixt-13112-agixt-1 | INFO: Waiting for application startup.
agixt-13112-agixt-1 | INFO: Application startup complete.
agixt-13112-agixt-1 | INFO: Started server process [16]
agixt-13112-agixt-1 | INFO: Waiting for application startup.
agixt-13112-agixt-1 | INFO: Application startup complete.
agixt-13112-agixt-1 | INFO: Started server process [19]
agixt-13112-agixt-1 | INFO: Waiting for application startup.
agixt-13112-agixt-1 | INFO: Application startup complete.
agixt-13112-agixt-1 | INFO: Started server process [20]
agixt-13112-agixt-1 | INFO: Waiting for application startup.
agixt-13112-agixt-1 | INFO: Application startup complete.
agixt-13112-agixt-1 | INFO: Started server process [17]
agixt-13112-agixt-1 | INFO: Waiting for application startup.
agixt-13112-agixt-1 | INFO: Application startup complete.
agixt-13112-agixt-1 | INFO: Started server process [14]
agixt-13112-agixt-1 | INFO: Waiting for application startup.
agixt-13112-agixt-1 | INFO: Application startup complete.
agixt-13112-agixt-1 | INFO: Started server process [18]
agixt-13112-agixt-1 | INFO: Waiting for application startup.
agixt-13112-agixt-1 | INFO: Application startup complete.
agixt-13112-agixt-1 | INFO: Started server process [13]
agixt-13112-agixt-1 | INFO: Waiting for application startup.
agixt-13112-agixt-1 | INFO: Application startup complete.
agixt-13112-agixt-1 | INFO: Started server process [21]
agixt-13112-agixt-1 | INFO: Waiting for application startup.
agixt-13112-agixt-1 | INFO: Application startup complete.
agixt-13112-agixt-1 | INFO: Started server process [22]
agixt-13112-agixt-1 | INFO: Waiting for application startup.
agixt-13112-agixt-1 | INFO: Application startup complete.
agixt-13112-agixt-1 | INFO: 172.20.0.3:56756 - "GET /api/Agent/conversations HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:56764 - "GET /api/conversation HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:56780 - "GET /api/agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.1:34434 - "GET / HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.1:34434 - "GET /openapi.json HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:35142 - "GET /api/Agent/conversations HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:35154 - "GET /api/conversation HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:35166 - "GET /api/agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:35180 - "GET /api/provider HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:35184 - "GET /api/embedding_providers HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:35200 - "GET /api/extensions/settings HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:35212 - "GET /api/agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:35224 - "GET /api/agent/Agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:50320 - "GET /api/agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:50322 - "GET /api/agent/Agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:50330 - "GET /api/provider/kobold HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:50332 - "GET /api/extensions HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:46628 - "GET /api/agent/Agent/command HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:35658 - "GET /api/agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:35662 - "GET /api/agent/Agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:45786 - "GET /api/agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:45798 - "GET /api/agent/Agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:45812 - "GET /api/agent/Agent/command HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:45814 - "PUT /api/agent/Agent/commands HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:35938 - "PUT /api/agent/Agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:58314 - "GET /api/Agent/conversations HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:58322 - "GET /api/conversation HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:58328 - "GET /api/agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:58334 - "GET /api/Agent/conversations HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:58350 - "GET /api/conversation HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:58366 - "GET /api/agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:58370 - "GET /api/agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:58374 - "GET /api/Agent/conversations HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:58382 - "GET /api/conversation HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:58390 - "GET /api/agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:56630 - "GET /api/Agent/conversations HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:56636 - "GET /api/conversation HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:56650 - "GET /api/agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:56664 - "GET /api/Agent/conversations HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:56676 - "GET /api/conversation HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 172.20.0.3:56692 - "GET /api/agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | INFO: 127.0.0.1:48608 - "GET /api/agent/Agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | 2023-08-25 13:10:11,416 | INFO | CONTEXT RESULTS: 5
agixt-13112-agixt-1 | 2023-08-25 13:10:12,015 | INFO | FORMATTED PROMPT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:10:12,016 | INFO | Error: HTTPConnectionPool(host='127.0.0.1', port=8000): Max retries exceeded with url: /api/v1/api/v1/generate (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f3deb017610>: Failed to establish a new connection: [Errno 111] Connection refused'))
agixt-13112-agixt-1 | 2023-08-25 13:10:12,016 | INFO | PROMPT CONTENT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:10:12,016 | INFO | TOKENS: 42
agixt-13112-agixt-1 | 2023-08-25 13:10:12,016 | INFO | Retrying in 10 seconds...
agixt-13112-agixt-1 | INFO: 127.0.0.1:54146 - "GET /api/agent/Agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | 2023-08-25 13:10:29,103 | INFO | CONTEXT RESULTS: 4
agixt-13112-agixt-1 | 2023-08-25 13:10:29,712 | INFO | FORMATTED PROMPT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:10:29,713 | INFO | Error: HTTPConnectionPool(host='127.0.0.1', port=8000): Max retries exceeded with url: /api/v1/api/v1/generate (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7efd6d764e80>: Failed to establish a new connection: [Errno 111] Connection refused'))
agixt-13112-agixt-1 | 2023-08-25 13:10:29,713 | INFO | PROMPT CONTENT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:10:29,713 | INFO | TOKENS: 42
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:10:29,713 | INFO | Retrying in 10 seconds...
agixt-13112-agixt-1 | INFO: 127.0.0.1:51316 - "GET /api/agent/Agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | 2023-08-25 13:10:46,345 | INFO | CONTEXT RESULTS: 3
agixt-13112-agixt-1 | 2023-08-25 13:10:46,926 | INFO | FORMATTED PROMPT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:10:46,927 | INFO | Error: HTTPConnectionPool(host='127.0.0.1', port=8000): Max retries exceeded with url: /api/v1/api/v1/generate (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fdfd1408fa0>: Failed to establish a new connection: [Errno 111] Connection refused'))
agixt-13112-agixt-1 | 2023-08-25 13:10:46,927 | INFO | PROMPT CONTENT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:10:46,927 | INFO | TOKENS: 42
agixt-13112-agixt-1 | 2023-08-25 13:10:46,927 | INFO | Retrying in 10 seconds...
agixt-13112-agixt-1 | INFO: 127.0.0.1:59804 - "GET /api/agent/Agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | 2023-08-25 13:11:03,392 | INFO | CONTEXT RESULTS: 2
agixt-13112-agixt-1 | 2023-08-25 13:11:04,373 | INFO | FORMATTED PROMPT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:11:04,379 | INFO | Error: HTTPConnectionPool(host='127.0.0.1', port=8000): Max retries exceeded with url: /api/v1/api/v1/generate (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f700356a3b0>: Failed to establish a new connection: [Errno 111] Connection refused'))
agixt-13112-agixt-1 | 2023-08-25 13:11:04,379 | INFO | PROMPT CONTENT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:11:04,379 | INFO | TOKENS: 42
agixt-13112-agixt-1 | 2023-08-25 13:11:04,379 | INFO | Retrying in 10 seconds...
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | INFO: 127.0.0.1:34556 - "GET /api/agent/Agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | 2023-08-25 13:11:22,544 | INFO | CONTEXT RESULTS: 1
agixt-13112-agixt-1 | 2023-08-25 13:11:23,451 | INFO | FORMATTED PROMPT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:11:23,452 | INFO | Error: HTTPConnectionPool(host='127.0.0.1', port=8000): Max retries exceeded with url: /api/v1/api/v1/generate (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f8756f306d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
agixt-13112-agixt-1 | 2023-08-25 13:11:23,452 | INFO | PROMPT CONTENT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:11:23,452 | INFO | TOKENS: 42
agixt-13112-agixt-1 | 2023-08-25 13:11:23,452 | INFO | Retrying in 10 seconds...
agixt-13112-agixt-1 | INFO: 127.0.0.1:37164 - "GET /api/agent/Agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | 2023-08-25 13:11:40,390 | INFO | CONTEXT RESULTS: 0
agixt-13112-agixt-1 | 2023-08-25 13:11:40,695 | INFO | FORMATTED PROMPT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:11:40,696 | INFO | Error: HTTPConnectionPool(host='127.0.0.1', port=8000): Max retries exceeded with url: /api/v1/api/v1/generate (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fddfdb70c40>: Failed to establish a new connection: [Errno 111] Connection refused'))
agixt-13112-agixt-1 | 2023-08-25 13:11:40,696 | INFO | PROMPT CONTENT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:11:40,696 | INFO | TOKENS: 42
agixt-13112-agixt-1 | 2023-08-25 13:11:40,697 | INFO | Retrying in 10 seconds...
agixt-13112-agixt-1 | INFO: 127.0.0.1:40964 - "GET /api/agent/Agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | 2023-08-25 13:11:57,319 | INFO | CONTEXT RESULTS: 0
agixt-13112-agixt-1 | 2023-08-25 13:11:57,625 | INFO | FORMATTED PROMPT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:11:57,626 | INFO | Error: HTTPConnectionPool(host='127.0.0.1', port=8000): Max retries exceeded with url: /api/v1/api/v1/generate (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fc10f3fd2a0>: Failed to establish a new connection: [Errno 111] Connection refused'))
agixt-13112-agixt-1 | 2023-08-25 13:11:57,626 | INFO | PROMPT CONTENT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:11:57,626 | INFO | TOKENS: 42
agixt-13112-agixt-1 | 2023-08-25 13:11:57,626 | INFO | Retrying in 10 seconds...
agixt-13112-agixt-1 | INFO: 127.0.0.1:47510 - "GET /api/agent/Agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | 2023-08-25 13:12:14,361 | INFO | CONTEXT RESULTS: 0
agixt-13112-agixt-1 | 2023-08-25 13:12:14,665 | INFO | FORMATTED PROMPT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:12:14,666 | INFO | Error: HTTPConnectionPool(host='127.0.0.1', port=8000): Max retries exceeded with url: /api/v1/api/v1/generate (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f17c161a350>: Failed to establish a new connection: [Errno 111] Connection refused'))
agixt-13112-agixt-1 | 2023-08-25 13:12:14,666 | INFO | PROMPT CONTENT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:12:14,666 | INFO | TOKENS: 42
agixt-13112-agixt-1 | 2023-08-25 13:12:14,666 | INFO | Retrying in 10 seconds...
agixt-13112-agixt-1 | INFO: 127.0.0.1:52682 - "GET /api/agent/Agent HTTP/1.1" 200 OK
agixt-13112-agixt-1 | 2023-08-25 13:12:31,908 | INFO | CONTEXT RESULTS: 0
agixt-13112-agixt-1 | 2023-08-25 13:12:32,234 | INFO | FORMATTED PROMPT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:12:32,235 | INFO | Error: HTTPConnectionPool(host='127.0.0.1', port=8000): Max retries exceeded with url: /api/v1/api/v1/generate (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fab2b4bd2a0>: Failed to establish a new connection: [Errno 111] Connection refused'))
agixt-13112-agixt-1 | 2023-08-25 13:12:32,235 | INFO | PROMPT CONTENT:
agixt-13112-agixt-1 | You are Agent, an expert at answering the users question. Use available context help answer the users questions.
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | Recent conversation history for context:
agixt-13112-agixt-1 |
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | User's latest input: Hello who are you?
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:12:32,235 | INFO | TOKENS: 42
agixt-13112-agixt-1 |
agixt-13112-agixt-1 | 2023-08-25 13:12:32,235 | INFO | Retrying in 10 seconds...
I meant that it doesn't matter which AI_PROVIDER_URI I set. The error is always like this. No AI_PROVIDER_URI verification. I like how it's done in SillyTavern-1.9.7. There is a connection indicator, and it is immediately clear whether there is a connection or not. Thank You for your work! A very interesting project.
In short, I take it I need to manipulate Docker's network settings? I understand correctly? Containers don't have access to the host's network by default? I'll deal with it now. But the manual doesn't say anything about configuring the docker network settings to successfully communicate with Kobold.cpp It somehow didn't occur to me about the docker network settings
Thank you very much Josh-XT for taking the time to make a video guide https://www.youtube.com/watch?v=XbjjPdYRM_k This cleared up for me a lot of incomprehensible moments in setting up AGiXT. I recommend pinning this video guide to the GitHub Home page. In my opinion, this will greatly increase the attractiveness of the project.
Josh-XT
I figured it out! I finally got it all working! It turns out that it was necessary to set HOST 0.0.0.0 in the Kobold.cpp settings so that it would listen to everyone and PORT: any free port, for example 8000
Then find out the name of your local host in the terminal with the command hostname
Let's say our hostname is GOOOD
AI_PROVIDER_URI set http://GOOOD:8000/api/v1
It all has to do with Docker's network settings, this was the easiest of the options. ChatGPT helped me figure it out.
Josh-XT I beg you. Complete the documentation https://josh-xt.github.io/AGiXT/3-Providers/Kobold.html I spent a lot of time on this. I suffered))).
Josh-XT I figured it out! I finally got it all working! It turns out that it was necessary to set HOST 0.0.0.0 in the Kobold.cpp settings so that it would listen to everyone and PORT: any free port, for example 8000 Then find out the name of your local host in the terminal with the command hostname Let's say our hostname is GOOOD AI_PROVIDER_URI set http://GOOOD:8000/api/v1 It all has to do with Docker's network settings, this was the easiest of the options. ChatGPT helped me figure it out.
Josh-XT I beg you. Complete the documentation https://josh-xt.github.io/AGiXT/3-Providers/Kobold.html I spent a lot of time on this. I suffered))).
Hello @pegas07770 ! I'm glad to hear you got it working.
Any modifications to the documentation to better it are greatly appreciated contributions! If you have specific suggestions to update the documentation, hit the link below and hit the edit button. You can make any modifications you feel are necessary from there then after you save it, click to do a pull request
. I see those requests when they are put in and I can choose to accept your changes or modify them and push them to production very easily from there.
https://github.com/Josh-XT/AGiXT/blob/main/docs/3-Providers/Kobold.md
Thank you!
Josh-XT, I'll try to do it. But I can not promise. Because I'm new to github and haven't figured out how to properly make a pull request yet. In addition, I do not know English well, I communicate with you through an interpreter. But I will try to supplement the documentation if I can figure it out.
Description
I carefully watched the video https://www.youtube.com/watch?v=XbjjPdYRM_k But the agent I created cannot chat in the AGiXT v1.3.122 Latest. Agent Interactions tab. I configured everything as in the video, I practically did not change the agent settings. I have tried different variations of AI_PROVIDER_URI (http://localhost:5050/api/v1 http://localhost:5050/api http://localhost:5050). All AI_PROVIDER_URI variants always corresponded to active Kobold.cpp servers with a running LLM model. The generation in Kobold.cpp and SillyTavern-1.9.7 has always been successful. I have tried almost every possible setting for the Agent and Kobold.cpp. I changed the Kobold.cpp server to other ports. But all to no avail. Always the same error. Here is one variation of this error with AI_PROVIDER_URI http://localhost:5050/api/v1
Steps to Reproduce the Bug
1) Running Kobold.cpp with different LLM models 2) Checking the generation of texts LLM models в Kobold.cpp 3)Configuring the AGiXT Agent (AI_PROVIDER_URI, provider, and so on) 4) Attempt to chat with an agent on the Agent Interactions tab
Expected Behavior
Agent work with Kobold.cpp
Operating System
Python Version
Environment Type - Connection
Runtime environment
Acknowledgements