search

zylon-ai / private-gpt

Interact with your documents using the power of GPT, 100% privately, no data leaks
https://privategpt.dev
Apache License 2.0
53.51k stars 7.19k forks source link

Docker compose up doesnt't work #1546

Open floradu88 opened 7 months ago

floradu88 commented 7 months ago

Tried docker compose up and this is the output in windows 10 with docker for windows latest.

privategpt-private-gpt-1 | 10:51:37.924 [INFO ] private_gpt.settings.settings_loader - Starting application with profiles=['default', 'docker'] privategpt-private-gpt-1 | There was a problem when trying to write in your cache folder (/nonexistent/.cache/huggingface/hub). You should set the environment variable TRANSFORMERS_CACHE to a writable directory. privategpt-private-gpt-1 | 10:52:27.176 [WARNING ] matplotlib - Matplotlib created a temporary cache directory at /tmp/matplotlib-x6bb5utr because the default path (/nonexistent/.config/matplotlib) is not a writable directory; it is highly recommended to set the MPLCONFIGDIR environment variable to a writable directory, in particular to speed up the import of Matplotlib and to better support multiprocessing. privategpt-private-gpt-1 | 10:52:47.847 [INFO ] matplotlib.font_manager - generated new fontManager privategpt-private-gpt-1 | 10:53:06.529 [INFO ] private_gpt.components.llm.llm_component - Initializing the LLM in mode=local privategpt-private-gpt-1 | Traceback (most recent call last): privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 798, in get privategpt-private-gpt-1 | return self._context[key] privategpt-private-gpt-1 | ~~~~~^^^^^ privategpt-private-gpt-1 | KeyError: <class 'private_gpt.ui.ui.PrivateGptUi'> privategpt-private-gpt-1 | privategpt-private-gpt-1 | During handling of the above exception, another exception occurred: privategpt-private-gpt-1 | privategpt-private-gpt-1 | Traceback (most recent call last): privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 798, in get privategpt-private-gpt-1 | return self._context[key] privategpt-private-gpt-1 | ~~~~~^^^^^ privategpt-private-gpt-1 | KeyError: <class 'private_gpt.server.ingest.ingest_service.IngestService'> privategpt-private-gpt-1 | privategpt-private-gpt-1 | During handling of the above exception, another exception occurred: privategpt-private-gpt-1 | privategpt-private-gpt-1 | Traceback (most recent call last): privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 798, in get privategpt-private-gpt-1 | return self._context[key] privategpt-private-gpt-1 | ~~~~~^^^^^ privategpt-private-gpt-1 | KeyError: <class 'private_gpt.components.llm.llm_component.LLMComponent'> privategpt-private-gpt-1 | privategpt-private-gpt-1 | During handling of the above exception, another exception occurred: privategpt-private-gpt-1 | privategpt-private-gpt-1 | Traceback (most recent call last): privategpt-private-gpt-1 | File "", line 198, in _run_module_as_main privategpt-private-gpt-1 | File "", line 88, in _run_code privategpt-private-gpt-1 | File "/home/worker/app/private_gpt/main.py", line 5, in privategpt-private-gpt-1 | from private_gpt.main import app privategpt-private-gpt-1 | File "/home/worker/app/private_gpt/main.py", line 11, in privategpt-private-gpt-1 | app = create_app(global_injector) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/private_gpt/launcher.py", line 50, in create_app privategpt-private-gpt-1 | ui = root_injector.get(PrivateGptUi) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 91, in wrapper privategpt-private-gpt-1 | return function(*args, kwargs) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 974, in get privategpt-private-gpt-1 | provider_instance = scope_instance.get(interface, binding.provider) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 91, in wrapper privategpt-private-gpt-1 | return function(*args, *kwargs) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 800, in get privategpt-private-gpt-1 | instance = self._get_instance(key, provider, self.injector) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 811, in _get_instance privategpt-private-gpt-1 | return provider.get(injector) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 264, in get privategpt-private-gpt-1 | return injector.create_object(self._cls) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 998, in create_object privategpt-private-gpt-1 | self.call_withinjection(init, self=instance, kwargs=additional_kwargs) privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 1031, in call_with_injection privategpt-private-gpt-1 | dependencies = self.args_to_inject( privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 91, in wrapper privategpt-private-gpt-1 | return function(args, kwargs) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 1079, in args_to_inject privategpt-private-gpt-1 | instance: Any = self.get(interface) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 91, in wrapper privategpt-private-gpt-1 | return function(*args, kwargs) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 974, in get privategpt-private-gpt-1 | provider_instance = scope_instance.get(interface, binding.provider) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 91, in wrapper privategpt-private-gpt-1 | return function(*args, *kwargs) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 800, in get privategpt-private-gpt-1 | instance = self._get_instance(key, provider, self.injector) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 811, in _get_instance privategpt-private-gpt-1 | return provider.get(injector) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 264, in get privategpt-private-gpt-1 | return injector.create_object(self._cls) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 998, in create_object privategpt-private-gpt-1 | self.call_withinjection(init, self=instance, kwargs=additional_kwargs) privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 1031, in call_with_injection privategpt-private-gpt-1 | dependencies = self.args_to_inject( privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 91, in wrapper privategpt-private-gpt-1 | return function(args, kwargs) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 1079, in args_to_inject privategpt-private-gpt-1 | instance: Any = self.get(interface) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 91, in wrapper privategpt-private-gpt-1 | return function(*args, kwargs) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 974, in get privategpt-private-gpt-1 | provider_instance = scope_instance.get(interface, binding.provider) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 91, in wrapper privategpt-private-gpt-1 | return function(*args, *kwargs) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 800, in get privategpt-private-gpt-1 | instance = self._get_instance(key, provider, self.injector) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 811, in _get_instance privategpt-private-gpt-1 | return provider.get(injector) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 264, in get privategpt-private-gpt-1 | return injector.create_object(self._cls) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 998, in create_object privategpt-private-gpt-1 | self.call_withinjection(init, self=instance, kwargs=additional_kwargs) privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/init.py", line 1040, in call_with_injection privategpt-private-gpt-1 | return callable(full_args, dependencies) privategpt-private-gpt-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/private_gpt/components/llm/llm_component.py", line 38, in init privategpt-private-gpt-1 | self.llm = LlamaCPP( privategpt-private-gpt-1 | ^^^^^^^^^ privategpt-private-gpt-1 | File "/home/worker/app/.venv/lib/python3.11/site-packages/llama_index/llms/llama_cpp.py", line 119, in init privategpt-private-gpt-1 | raise ValueError( privategpt-private-gpt-1 | ValueError: Provided model path does not exist. Please check the path or provide a model_url to download.

StupiduserIAM commented 7 months ago

Similar Issue

Mine shut down properly on Friday. Will not start again today. Only noticeable change is Tokenizer and Keys missing.

15:09:59.792 [INFO ] private_gpt.settings.settings_loader - Starting application with profiles=['default'] 15:10:09.699 [INFO ] private_gpt.components.llm.llm_component - Initializing the LLM in mode=local Traceback (most recent call last): File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector__init__.py", line 798, in get return self._context[key]


KeyError: <class 'private_gpt.ui.ui.PrivateGptUi'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 798, in get
    return self._context[key]
           ~~~~~~~~~~~~~^^^^^
KeyError: <class 'private_gpt.server.ingest.ingest_service.IngestService'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 798, in get
    return self._context[key]
           ~~~~~~~~~~~~~^^^^^
KeyError: <class 'private_gpt.components.llm.llm_component.LLMComponent'>

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\llama_cpp\llama_cpp.py", line 69, in _load_shared_library
    return ctypes.CDLL(str(_lib_path), **cdll_args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\ctypes\__init__.py", line 376, in __init__
    self._handle = _dlopen(self._name, mode)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: [WinError 1114] A dynamic link library (DLL) initialization routine failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "C:\sdagpt\privateGPT\private_gpt\__main__.py", line 5, in <module>
    from private_gpt.main import app
  File "C:\sdagpt\privateGPT\private_gpt\main.py", line 11, in <module>
    app = create_app(global_injector)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\sdagpt\privateGPT\private_gpt\launcher.py", line 50, in create_app
    ui = root_injector.get(PrivateGptUi)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 974, in get
    provider_instance = scope_instance.get(interface, binding.provider)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 800, in get
    instance = self._get_instance(key, provider, self.injector)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 811, in _get_instance
    return provider.get(injector)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 264, in get
    return injector.create_object(self._cls)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 998, in create_object
    self.call_with_injection(init, self_=instance, kwargs=additional_kwargs)
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 1031, in call_with_injection
    dependencies = self.args_to_inject(
                   ^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 1079, in args_to_inject
    instance: Any = self.get(interface)
                    ^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 974, in get
    provider_instance = scope_instance.get(interface, binding.provider)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 800, in get
    instance = self._get_instance(key, provider, self.injector)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 811, in _get_instance
    return provider.get(injector)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 264, in get
    return injector.create_object(self._cls)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 998, in create_object
    self.call_with_injection(init, self_=instance, kwargs=additional_kwargs)
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 1031, in call_with_injection
    dependencies = self.args_to_inject(
                   ^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 1079, in args_to_inject
    instance: Any = self.get(interface)
                    ^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 974, in get
    provider_instance = scope_instance.get(interface, binding.provider)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 91, in wrapper
    return function(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 800, in get
    instance = self._get_instance(key, provider, self.injector)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 811, in _get_instance
    return provider.get(injector)
           ^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 264, in get
    return injector.create_object(self._cls)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 998, in create_object
    self.call_with_injection(init, self_=instance, kwargs=additional_kwargs)
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\injector\__init__.py", line 1040, in call_with_injection
    return callable(*full_args, **dependencies)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\sdagpt\privateGPT\private_gpt\components\llm\llm_component.py", line 38, in __init__
    self.llm = LlamaCPP(
               ^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\llama_index\llms\llama_cpp.py", line 102, in __init__
    from llama_cpp import Llama
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\llama_cpp\__init__.py", line 1, in <module>
    from .llama_cpp import *
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\llama_cpp\llama_cpp.py", line 82, in <module>
    _lib = _load_shared_library(_lib_base_name)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\llama_cpp\llama_cpp.py", line 71, in _load_shared_library
    raise RuntimeError(f"Failed to load shared library '{_lib_path}': {e}")
RuntimeError: Failed to load shared library 'C:\ProgramData\anaconda3\envs\sda\Lib\site-packages\llama_cpp\llama.dll': [WinError 1114] A dynamic link library (DLL) initialization routine failed
FelixMMueller commented 7 months ago

Same Problem here

Successfully built 313afb05c35e
Successfully tagged privategpt_private-gpt:latest
Creating privategpt_private-gpt_1 ... done
Attaching to privategpt_private-gpt_1
private-gpt_1  | 15:16:11.961 [INFO    ] private_gpt.settings.settings_loader - Starting application with profiles=['default', 'docker']
private-gpt_1  | There was a problem when trying to write in your cache folder (/nonexistent/.cache/huggingface/hub). You should set the environment variable TRANSFORMERS_CACHE to a writable directory.
private-gpt_1  | 15:16:18.844 [WARNING ]                matplotlib - Matplotlib created a temporary cache directory at /tmp/matplotlib-wiyqqddm because the default path (/nonexistent/.config/matplotlib) is not a writable directory; it is highly recommended to set the MPLCONFIGDIR environment variable to a writable directory, in particular to speed up the import of Matplotlib and to better support multiprocessing.
private-gpt_1  | 15:16:19.579 [INFO    ]   matplotlib.font_manager - generated new fontManager
private-gpt_1  | 15:16:26.203 [INFO    ] private_gpt.components.llm.llm_component - Initializing the LLM in mode=local
private-gpt_1  | Traceback (most recent call last):
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 798, in get
private-gpt_1  |     return self._context[key]
private-gpt_1  |            ~~~~~~~~~~~~~^^^^^
private-gpt_1  | KeyError: <class 'private_gpt.ui.ui.PrivateGptUi'>
private-gpt_1  | 
private-gpt_1  | During handling of the above exception, another exception occurred:
private-gpt_1  | 
private-gpt_1  | Traceback (most recent call last):
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 798, in get
private-gpt_1  |     return self._context[key]
private-gpt_1  |            ~~~~~~~~~~~~~^^^^^
private-gpt_1  | KeyError: <class 'private_gpt.server.ingest.ingest_service.IngestService'>
private-gpt_1  | 
private-gpt_1  | During handling of the above exception, another exception occurred:
private-gpt_1  | 
private-gpt_1  | Traceback (most recent call last):
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 798, in get
private-gpt_1  |     return self._context[key]
private-gpt_1  |            ~~~~~~~~~~~~~^^^^^
private-gpt_1  | KeyError: <class 'private_gpt.components.llm.llm_component.LLMComponent'>
private-gpt_1  | 
private-gpt_1  | During handling of the above exception, another exception occurred:
private-gpt_1  | 
private-gpt_1  | Traceback (most recent call last):
private-gpt_1  |   File "<frozen runpy>", line 198, in _run_module_as_main
private-gpt_1  |   File "<frozen runpy>", line 88, in _run_code
private-gpt_1  |   File "/home/worker/app/private_gpt/__main__.py", line 5, in <module>
private-gpt_1  |     from private_gpt.main import app
private-gpt_1  |   File "/home/worker/app/private_gpt/main.py", line 11, in <module>
private-gpt_1  |     app = create_app(global_injector)
private-gpt_1  |           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/private_gpt/launcher.py", line 50, in create_app
private-gpt_1  |     ui = root_injector.get(PrivateGptUi)
private-gpt_1  |          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
private-gpt_1  |     return function(*args, **kwargs)
private-gpt_1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 974, in get
private-gpt_1  |     provider_instance = scope_instance.get(interface, binding.provider)
private-gpt_1  |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
private-gpt_1  |     return function(*args, **kwargs)
private-gpt_1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 800, in get
private-gpt_1  |     instance = self._get_instance(key, provider, self.injector)
private-gpt_1  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 811, in _get_instance
private-gpt_1  |     return provider.get(injector)
private-gpt_1  |            ^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 264, in get
private-gpt_1  |     return injector.create_object(self._cls)
private-gpt_1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 998, in create_object
private-gpt_1  |     self.call_with_injection(init, self_=instance, kwargs=additional_kwargs)
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 1031, in call_with_injection
private-gpt_1  |     dependencies = self.args_to_inject(
private-gpt_1  |                    ^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
private-gpt_1  |     return function(*args, **kwargs)
private-gpt_1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 1079, in args_to_inject
private-gpt_1  |     instance: Any = self.get(interface)
private-gpt_1  |                     ^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
private-gpt_1  |     return function(*args, **kwargs)
private-gpt_1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 974, in get
private-gpt_1  |     provider_instance = scope_instance.get(interface, binding.provider)
private-gpt_1  |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
private-gpt_1  |     return function(*args, **kwargs)
private-gpt_1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 800, in get
private-gpt_1  |     instance = self._get_instance(key, provider, self.injector)
private-gpt_1  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 811, in _get_instance
private-gpt_1  |     return provider.get(injector)
private-gpt_1  |            ^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 264, in get
private-gpt_1  |     return injector.create_object(self._cls)
private-gpt_1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 998, in create_object
private-gpt_1  |     self.call_with_injection(init, self_=instance, kwargs=additional_kwargs)
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 1031, in call_with_injection
private-gpt_1  |     dependencies = self.args_to_inject(
private-gpt_1  |                    ^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
private-gpt_1  |     return function(*args, **kwargs)
private-gpt_1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 1079, in args_to_inject
private-gpt_1  |     instance: Any = self.get(interface)
private-gpt_1  |                     ^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
private-gpt_1  |     return function(*args, **kwargs)
private-gpt_1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 974, in get
private-gpt_1  |     provider_instance = scope_instance.get(interface, binding.provider)
private-gpt_1  |                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 91, in wrapper
private-gpt_1  |     return function(*args, **kwargs)
private-gpt_1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 800, in get
private-gpt_1  |     instance = self._get_instance(key, provider, self.injector)
private-gpt_1  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 811, in _get_instance
private-gpt_1  |     return provider.get(injector)
private-gpt_1  |            ^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 264, in get
private-gpt_1  |     return injector.create_object(self._cls)
private-gpt_1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 998, in create_object
private-gpt_1  |     self.call_with_injection(init, self_=instance, kwargs=additional_kwargs)
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/injector/__init__.py", line 1040, in call_with_injection
private-gpt_1  |     return callable(*full_args, **dependencies)
private-gpt_1  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/private_gpt/components/llm/llm_component.py", line 38, in __init__
private-gpt_1  |     self.llm = LlamaCPP(
private-gpt_1  |                ^^^^^^^^^
private-gpt_1  |   File "/home/worker/app/.venv/lib/python3.11/site-packages/llama_index/llms/llama_cpp.py", line 119, in __init__
private-gpt_1  |     raise ValueError(
private-gpt_1  | ValueError: Provided model path does not exist. Please check the path or provide a model_url to download.
privategpt_private-gpt_1 exited with code 1
FelixMMueller commented 7 months ago

I could solve to problem with the missing models in that way that I did some adjustments to the settings-docker.yaml file. The problem was that the current settings-docker.yaml references to mistra 0.1 model but the local version alsready uses 0.2.

So I changes this:

local:
  llm_hf_repo_id: ${PGPT_HF_REPO_ID:TheBloke/Mistral-7B-Instruct-v0.1-GGUF}
  llm_hf_model_file: ${PGPT_HF_MODEL_FILE:mistral-7b-instruct-v0.1.Q4_K_M.gguf}
  embedding_hf_model_name: ${PGPT_EMBEDDING_HF_MODEL_NAME:BAAI/bge-small-en-v1.5}

To this:

local:
  llm_hf_repo_id: ${PGPT_HF_REPO_ID:TheBloke/Mistral-7B-Instruct-v0.2-GGUF}
  llm_hf_model_file: ${PGPT_HF_MODEL_FILE:mistral-7b-instruct-v0.2.Q4_K_M.gguf}
  embedding_hf_model_name: ${PGPT_EMBEDDING_HF_MODEL_NAME:BAAI/bge-small-en-v1.5}
jlindsay commented 6 months ago

I'm having the same problem... I tried @FelixMMueller suggesting by updating the settings-docker.yaml file, however I'm still get the same error, @FelixMMueller was there something else you did to actually get docker_compose up to work properly? I must be missing something. thanks in advance. ~j