ProjCRys
commented
11 months ago Running main.py always causes an error, they havent' fixed it yet. However I have a workaround for this:
https://www.youtube.com/watch?v=zHtFuQiqhIo
Here's the bat file, make sure to change the file directories to where your python and venv folder will be: @echo off
:: Define the paths to Python and the venv set PYTHON_EXECUTABLE=C:\Users\ADMIN\AppData\Local\Programs\Python\Python310\python.exe set VENV_DIR=D:\AI\ChatBots\MemGPT_Setup\venv
:: Create the virtual environment "%PYTHON_EXECUTABLE%" -m venv "%VENV_DIR%"
:: Check if the virtual environment creation was successful if %errorlevel% neq 0 ( echo An error occurred while creating the virtual environment. Press any key to exit. pause >nul exit /b %errorlevel% )
:: Activate the virtual environment call "%VENV_DIR%\Scripts\activate"
:: Install pymemgpt using pip pip install pymemgpt pip install transformers pip install torch
:: Check if the installation was successful if %errorlevel% neq 0 ( echo An error occurred while installing pymemgpt. Press any key to exit. pause >nul exit /b %errorlevel% )
set OPENAI_API_BASE=http://localhost:1234 set BACKEND_TYPE=lmstudio cls
:: Run memgpt (replace this with your specific memgpt command) memgpt run --no_verify
:: Check if memgpt encountered an error if %errorlevel% neq 0 ( echo An error occurred while running memgpt. Press any key to exit. pause >nul exit /b %errorlevel% )
:: Deactivate the virtual environment deactivate
:: Pause to allow the user to review the output echo Press any key to exit. pause >nul
pligor
sarahwooders
but upon execution of 
cpacker
Describe the bug Basically when
To Reproduce Steps to reproduce the behavior:
python main.py --no_verifyExpected behavior A clear and concise description of what you expected to happen.
Screenshots
Additional context export OPENAI_API_BASE=http://127.0.0.1:5050 export BACKEND_TYPE=lmstudio
How did you install MemGPT? From source with
git clone git@github.com:cpacker/MemGPT.gitandpip install -r requirements.txtYour setup (please complete the following information)
python --version): 3.11.4git describe --tags): 0.1.15-36-g54e5aefLocal LLM details
If you are trying to run MemGPT with local LLMs, please provide the following information:
Warning: no wrapper specified for local LLM, using the default wrapper step() failed user_message = None error = Failed to decode JSON from LLM output: {"Hello! Welcome to the Assistant, you've finally decided to join us. I'm so excited to help y..." }
An exception ocurred when running agent.step(): Traceback (most recent call last): File "/Users/gp/Desktop/MemGPT/memgpt/local_llm/llm_chat_completion_wrappers/airoboros.py", line 392, in output_to_chat_completion_response function_json_output = json.loads(raw_llm_output) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/gp/anaconda3/lib/python3.11/json/init.py", line 346, in loads return _default_decoder.decode(s) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/gp/anaconda3/lib/python3.11/json/decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/gp/anaconda3/lib/python3.11/json/decoder.py", line 353, in raw_decode obj, end = self.scan_once(s, idx) ^^^^^^^^^^^^^^^^^^^^^^ json.decoder.JSONDecodeError: Expecting ':' delimiter: line 2 column 1 (char 99)
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/Users/gp/Desktop/MemGPT/memgpt/local_llm/llm_chat_completion_wrappers/airoboros.py", line 395, in output_to_chat_completion_response function_json_output = json.loads(raw_llm_output + "\n}") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/gp/anaconda3/lib/python3.11/json/init.py", line 346, in loads return _default_decoder.decode(s) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/gp/anaconda3/lib/python3.11/json/decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/gp/anaconda3/lib/python3.11/json/decoder.py", line 353, in raw_decode obj, end = self.scan_once(s, idx) ^^^^^^^^^^^^^^^^^^^^^^ json.decoder.JSONDecodeError: Expecting ':' delimiter: line 2 column 1 (char 99)
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/Users/gp/Desktop/MemGPT/memgpt/main.py", line 544, in run_agent_loop new_messages, user_message, skip_next_user_input = await process_agent_step(user_message, no_verify) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/gp/Desktop/MemGPT/memgpt/main.py", line 520, in process_agent_step new_messages, heartbeat_request, function_failed, token_warning = await memgpt_agent.step( ^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/gp/Desktop/MemGPT/memgpt/agent.py", line 1084, in step raise e File "/Users/gp/Desktop/MemGPT/memgpt/agent.py", line 1029, in step response = await get_ai_reply_async(model=self.model, message_sequence=input_message_sequence, functions=self.functions) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/gp/Desktop/MemGPT/memgpt/agent.py", line 160, in get_ai_reply_async raise e File "/Users/gp/Desktop/MemGPT/memgpt/agent.py", line 141, in get_ai_reply_async response = await acreate( ^^^^^^^^^^^^^^ File "/Users/gp/Desktop/MemGPT/memgpt/openai_tools.py", line 115, in wrapper raise e File "/Users/gp/Desktop/MemGPT/memgpt/openai_tools.py", line 95, in wrapper return await func(*args, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/gp/Desktop/MemGPT/memgpt/openai_tools.py", line 124, in acompletions_with_backoff return get_chat_completion(kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/gp/Desktop/MemGPT/memgpt/local_llm/chat_completion_proxy.py", line 62, in get_chat_completion chat_completion_result = llm_wrapper.output_to_chat_completion_response(result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/gp/Desktop/MemGPT/memgpt/local_llm/llm_chat_completion_wrappers/airoboros.py", line 397, in output_to_chat_completion_response raise Exception(f"Failed to decode JSON from LLM output:\n{raw_llm_output}") Exception: Failed to decode JSON from LLM output: {"Hello! Welcome to the Assistant, you've finally decided to join us. I'm so excited to help y..." }