hayjohnny2000
commented
11 months ago Hi,
Thank you for this excellent plugin and project. I had a few problems installing the plugin with Pip so I created this issue to explain how I installed it using the Conda virtual environment/package manager for Python (instead of Pip) on Windows, in case it's helpful for others. Here are the steps I followed:
conda create -p D:\ProgramData\.conda_envs\lmstudio_chromadb python=3.11conda activate D:\ProgramData\.conda_envs\lmstudio_chromadbconda install mamba -c conda-forgemamba install pytorch torchvision torchaudio pytorch-cuda=11.8 -c pytorch -c nvidiamamba install -c conda-forge pyside6mamba install -c "nvidia/label/cuda-11.8.0" cuda-nvccmamba install -c conda-forge hnswlibSteps (1) and (2) create and activate the Conda/Python virtual environment. Step (3) installs
mamba, which is much faster for installing/managing packages than defaultcondais. Step (4) installs PyTorch and some of the CUDA dependencies. Step (5) installs thepyside6dependency. Step (6) installs thecuda-nvccpackage which is required for the setup script to recognise that CUDA is installed. Step (7) installs thehnswlib, and I think avoids the need to install the Microsoft Visual C++ build tools for Visual Studio separately. If thehnswlibpackage fails to install with compilation errors, it might still be necessary to install the build tools from https://learn.microsoft.com/en-us/cpp/windows/latest-supported-vc-redist?view=msvc-170#visual-studio-2015-2017-2019-and-2022.Hope this is helpful.
Update after loading the application with python gui.py:
For some reason, PySide6 is not automatically finding the paths to the platform plugin and QT WebEngine dependencies, so I ran the following command to install it with Pip: pip install --ignore-installed pyside6.
However, I still received the following error when I ran python gui.py:
qt.qpa.plugin: Could not load the Qt platform plugin "windows" in "" even though it was found.
This application failed to start because no Qt platform plugin could be initialized. Reinstalling the application may fix this problem.
Available platform plugins are: direct2d, minimal, offscreen, windows.I did some research and found I would have to set a few environment variables so the QT platform would be initialised properly. After a few iterations of other missing path errors, I managed to run the GUI. Unfortunately, this means some hacks added to the top of the gui.py module. The lines at the top of the file for importing libraries have been replaced as follows:
import os
import sys
import PySide6
from PySide6.QtWidgets import QApplication
pyqt = os.path.dirname(PySide6.__file__)
QApplication.addLibraryPath(os.path.join(pyqt, 'plugins'))
os.environ['QTWEBENGINEPROCESS_PATH'] = pyqt
os.environ['QTWEBENGINE_RESOURCES_PATH'] = os.path.join(pyqt, 'resources')
os.environ['QTWEBENGINE_LOCALES_PATH'] = os.path.join(pyqt, 'translations\qtwebengine_locales')
from PySide6.QtWidgets import (
QWidget, QPushButton, QVBoxLayout, QTabWidget,
QTextEdit, QSplitter, QFrame, QStyleFactory, QLabel, QGridLayout, QMenuBar, QCheckBox, QHBoxLayout, QMessageBox
)
from PySide6.QtCore import Qt, QTimer
from pathlib import Path
import torch
import yaml
import platform
import threading
from initialize import main as initialize_system
from metrics_bar import MetricsBar
from download_model import download_embedding_model
from select_model import select_embedding_model_directory
from choose_documents import choose_documents_directory, see_documents_directory
import create_database
from gui_tabs import create_tabs
from gui_threads import CreateDatabaseThread, SubmitButtonThread
import voice_recorder_module
from utilities import list_theme_files, make_theme_changer, load_stylesheet
from bark_module import BarkAudio
from constants import CHUNKS_ONLY_TOOLTIP, SPEAK_RESPONSE_TOOLTIPNot sure if this is being caused by installation of PySide6 through Conda, which is entirely possible. It does seem to be missing some environment variables or config somewhere. Hopefully when the issues with the library file paths in the package installation is resolved, this code can be removed from my gui.py. Till then, I will enjoy experimenting with RAG!
Thanks!
BBC-Esq
Hi,
Thank you for this excellent plugin and project. I had a few problems installing the plugin with Pip so I created this issue to explain how I installed it using the Conda virtual environment/package manager for Python (instead of Pip) on Windows, in case it's helpful for others. Here are the steps I followed:
conda create -p D:\ProgramData\.conda_envs\lmstudio_chromadb python=3.11conda activate D:\ProgramData\.conda_envs\lmstudio_chromadbconda install mamba -c conda-forgemamba install pytorch torchvision torchaudio pytorch-cuda=11.8 -c pytorch -c nvidiamamba install -c conda-forge pyside6mamba install -c "nvidia/label/cuda-11.8.0" cuda-nvccmamba install -c conda-forge hnswlibSteps (1) and (2) create and activate the Conda/Python virtual environment. Step (3) installs
mamba, which is much faster for installing/managing packages than defaultcondais. Step (4) installs PyTorch and some of the CUDA dependencies. Step (5) installs thepyside6dependency. Step (6) installs thecuda-nvccpackage which is required for the setup script to recognise that CUDA is installed. Step (7) installs thehnswlib, and I think avoids the need to install the Microsoft Visual C++ build tools for Visual Studio separately. If thehnswlibpackage fails to install with compilation errors, it might still be necessary to install the build tools from https://learn.microsoft.com/en-us/cpp/windows/latest-supported-vc-redist?view=msvc-170#visual-studio-2015-2017-2019-and-2022.Hope this is helpful.