search

ParisNeo / lollms-webui

Lord of Large Language Models Web User Interface
https://parisneo.github.io/lollms-webui/
Apache License 2.0
4.07k stars 515 forks source link

can't install it properly no matter what #513

Open Fuckingnameless opened 3 months ago

Fuckingnameless commented 3 months ago

Steps to Reproduce: ./install_linux-exllama.sh

end of installation process after downloading the airoboros model

Exception ignored in: <function ExLLamav2.__del__ at 0x7fdbc8aab6a0>
Traceback (most recent call last):
  File "/home/user/AI/lollms-webui/zoos/bindings_zoo/bs_exllamav2/__init__.py", line 134, in __del__
ImportError: sys.meta_path is None, Python is likely shutting down

trying to run /linux_run.sh

Starting LOLLMS Web UI...
      ___       ___           ___       ___       ___           ___      
     /\__\     /\  \         /\__\     /\__\     /\__\         /\  \     
    /:/  /    /::\  \       /:/  /    /:/  /    /::|  |       /::\  \    
   /:/  /    /:/\:\  \     /:/  /    /:/  /    /:|:|  |      /:/\ \  \   
  /:/  /    /:/  \:\  \   /:/  /    /:/  /    /:/|:|__|__   _\:\~\ \  \  
 /:/__/    /:/__/ \:\__\ /:/__/    /:/__/    /:/ |::::\__\ /\ \:\ \ \__\ 
 \:\  \    \:\  \ /:/  / \:\  \    \:\  \    \/__/~~/:/  / \:\ \:\ \/__/ 
  \:\  \    \:\  /:/  /   \:\  \    \:\  \         /:/  /   \:\ \:\__\   
   \:\  \    \:\/:/  /     \:\  \    \:\  \       /:/  /     \:\/:/  /   
    \:\__\    \::/  /       \:\__\    \:\__\     /:/  /       \::/  /    
     \/__/     \/__/         \/__/     \/__/     \/__/         \/__/     
 By ParisNeo
WARNING conda.exception_handler:print_unexpected_error_report(168): KeyError('active_prefix_name')
Traceback (most recent call last):
  File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/exception_handler.py", line 17, in __call__
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/cli/main.py", line 110, in main_sourced
    print(activator.execute(), end="")
          ^^^^^^^^^^^^^^^^^^^
  File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/activate.py", line 203, in execute
    return getattr(self, self.command)()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/activate.py", line 168, in activate
    builder_result = self.build_activate(self.env_name_or_prefix)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/activate.py", line 346, in build_activate
    return self._build_activate_stack(env_name_or_prefix, False)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/activate.py", line 375, in _build_activate_stack
    conda_prompt_modifier = self._prompt_modifier(prefix, conda_default_env)
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/activate.py", line 704, in _prompt_modifier
    old_shlvl = int(self.environ.get("CONDA_SHLVL", "0").rstrip())
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ValueError: invalid literal for int() with base 10: ''

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/exception_handler.py", line 165, in print_unexpected_error_report
    get_main_info_str(error_report["conda_info"])
  File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/cli/main_info.py", line 442, in get_main_info_str
    return "\n".join(("", *(f"{key:>23} : {value}" for key, value in builder()), ""))
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/cli/main_info.py", line 442, in <genexpr>
    return "\n".join(("", *(f"{key:>23} : {value}" for key, value in builder()), ""))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/cli/main_info.py", line 402, in builder
    if info_dict["active_prefix_name"]:
       ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'active_prefix_name'

# >>>>>>>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<<<<<<<

    Traceback (most recent call last):
      File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/exception_handler.py", line 17, in __call__
        return func(*args, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^
      File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/cli/main.py", line 110, in main_sourced
        print(activator.execute(), end="")
              ^^^^^^^^^^^^^^^^^^^
      File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/activate.py", line 203, in execute
        return getattr(self, self.command)()
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/activate.py", line 168, in activate
        builder_result = self.build_activate(self.env_name_or_prefix)
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/activate.py", line 346, in build_activate
        return self._build_activate_stack(env_name_or_prefix, False)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/activate.py", line 375, in _build_activate_stack
        conda_prompt_modifier = self._prompt_modifier(prefix, conda_default_env)
                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/home/user/AI/installer_files/miniconda3/lib/python3.12/site-packages/conda/activate.py", line 704, in _prompt_modifier
        old_shlvl = int(self.environ.get("CONDA_SHLVL", "0").rstrip())
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    ValueError: invalid literal for int() with base 10: ''

`$ /home/user/AI/installer_files/miniconda3/bin/conda shell.posix activate ./installer_files/lollms_env`

  environment variables:
conda info could not be constructed.
KeyError('active_prefix_name')

An unexpected error has occurred. Conda has prepared the above report.
If you suspect this error is being caused by a malfunctioning plugin,
consider using the --no-plugins option to turn off plugins.

Example: conda --no-plugins install <package>

Alternatively, you can set the CONDA_NO_PLUGINS environment variable on
the command line to run the command without plugins enabled.

Example: CONDA_NO_PLUGINS=true conda install <package>

Timeout reached. No report sent.

Traceback (most recent call last):
  File "/home/user/AI/lollms-webui/app.py", line 12, in <module>
    from lollms.app import LollmsApplication
ModuleNotFoundError: No module named 'lollms'
Press Enter to exit...

trying to run python app.py

Traceback (most recent call last):
  File "/home/user/AI/lollms-webui/app.py", line 12, in <module>
    from lollms.app import LollmsApplication
ModuleNotFoundError: No module named 'lollms'

Possible solution

1) how can i remove everything including dependencies and do a clean install? preferably using my own compiled torch 2) consider using pipx to install packages

ParisNeo commented 3 months ago

Hi, lollms install scripts install conda in the same folder then clones the git and start installing all dependencies. To remove everything just remove the folder that contains the installer.

It looks like you have a problem during the install as I see that conda environment is not being activated correctly. Lollms uses python 3.11 (exactly) and this is nistalled in a separate conda environment in the miniconda3 fodler.

Can you give more details on he install process?

Bets regards

Fuckingnameless commented 3 months ago

remove everything:


> rm -rf installer_files
> rm -rf lollms-webui
> conda remove --name lollms --all

conda environments:


> conda env list

base                     /opt/anaconda3
exllama                  /opt/anaconda3/envs/exllama

install via latest script


> mkdir lollms
> cd lollms
> wget linux_install_exllamav2.sh
> chmod +x ./linux_install_exllamav2.sh
> ./linux_install_exllamav2.sh

Installing Miniconda to /home/user/AI/lollms/installer_files/miniconda3 Please wait...

PREFIX=/home/user/AI/lollms/installer_files/miniconda3 Unpacking payload ...

Installing base environment...

Downloading and Extracting Packages:

Downloading and Extracting Packages:

Preparing transaction: done Executing transaction: done installation finished. Packages to install: python=3.11 Channels:

Package Plan

environment location: /home/user/AI/lollms/installer_files/lollms_env

added / updated specs:

The following packages will be downloaded:

package                    |            build
---------------------------|-----------------
bzip2-1.0.8                |       h5eee18b_5         262 KB
ca-certificates-2024.3.11  |       h06a4308_0         127 KB
pip-23.3.1                 |  py311h06a4308_0         3.3 MB
python-3.11.8              |       h955ad1f_0        32.9 MB
setuptools-68.2.2          |  py311h06a4308_0         1.2 MB
tzdata-2024a               |       h04d1e81_0         116 KB
wheel-0.41.2               |  py311h06a4308_0         145 KB
xz-5.4.6                   |       h5eee18b_0         651 KB
------------------------------------------------------------
                                       Total:        38.7 MB

The following NEW packages will be INSTALLED:

_libgcc_mutex pkgs/main/linux-64::_libgcc_mutex-0.1-main _openmp_mutex pkgs/main/linux-64::_openmp_mutex-5.1-1_gnu bzip2 pkgs/main/linux-64::bzip2-1.0.8-h5eee18b_5 ca-certificates pkgs/main/linux-64::ca-certificates-2024.3.11-h06a4308_0 ld_impl_linux-64 pkgs/main/linux-64::ld_impl_linux-64-2.38-h1181459_1 libffi pkgs/main/linux-64::libffi-3.4.4-h6a678d5_0 libgcc-ng pkgs/main/linux-64::libgcc-ng-11.2.0-h1234567_1 libgomp pkgs/main/linux-64::libgomp-11.2.0-h1234567_1 libstdcxx-ng pkgs/main/linux-64::libstdcxx-ng-11.2.0-h1234567_1 libuuid pkgs/main/linux-64::libuuid-1.41.5-h5eee18b_0 ncurses pkgs/main/linux-64::ncurses-6.4-h6a678d5_0 openssl pkgs/main/linux-64::openssl-3.0.13-h7f8727e_0 pip pkgs/main/linux-64::pip-23.3.1-py311h06a4308_0 python pkgs/main/linux-64::python-3.11.8-h955ad1f_0 readline pkgs/main/linux-64::readline-8.2-h5eee18b_0 setuptools pkgs/main/linux-64::setuptools-68.2.2-py311h06a4308_0 sqlite pkgs/main/linux-64::sqlite-3.41.2-h5eee18b_0 tk pkgs/main/linux-64::tk-8.6.12-h1ccaba5_0 tzdata pkgs/main/noarch::tzdata-2024a-h04d1e81_0 wheel pkgs/main/linux-64::wheel-0.41.2-py311h06a4308_0 xz pkgs/main/linux-64::xz-5.4.6-h5eee18b_0 zlib pkgs/main/linux-64::zlib-1.2.13-h5eee18b_0

Downloading and Extracting Packages:

Preparing transaction: done
Verifying transaction: done
Executing transaction: done

To activate this environment, use

$ conda activate /home/user/AI/lollms/installer_files/lollms_env

#

To deactivate an active environment, use

#

$ conda deactivate

Channels:

Package Plan

environment location: /home/user/AI/lollms/installer_files/lollms_env

added / updated specs:

The following packages will be downloaded:

package                    |            build
---------------------------|-----------------
archspec-0.2.3             |     pyhd3eb1b0_0          47 KB
boltons-23.0.0             |  py311h06a4308_0         477 KB
brotli-python-1.0.9        |  py311h6a678d5_7         318 KB
certifi-2024.2.2           |  py311h06a4308_0         160 KB
cffi-1.16.0                |  py311h5eee18b_0         314 KB
conda-24.3.0               |  py311h06a4308_0         1.2 MB
conda-libmamba-solver-24.1.0|     pyhd3eb1b0_0          39 KB
conda-package-handling-2.2.0|  py311h06a4308_0         278 KB
conda-package-streaming-0.9.0|  py311h06a4308_0          33 KB
distro-1.8.0               |  py311h06a4308_0          37 KB
idna-3.4                   |  py311h06a4308_0          96 KB
jsonpatch-1.33             |  py311h06a4308_0          37 KB
libmamba-1.5.6             |       haf1ee3a_0         1.8 MB
libmambapy-1.5.6           |  py311h2dafd23_0         315 KB
menuinst-2.0.2             |  py311h06a4308_0         167 KB
packaging-23.2             |  py311h06a4308_0         171 KB
platformdirs-3.10.0        |  py311h06a4308_0          37 KB
pluggy-1.0.0               |  py311h06a4308_1          32 KB
pycosat-0.6.6              |  py311h5eee18b_0          90 KB
pysocks-1.7.1              |  py311h06a4308_0          35 KB
requests-2.31.0            |  py311h06a4308_1         123 KB
ruamel.yaml-0.17.21        |  py311h5eee18b_0         249 KB
tqdm-4.65.0                |  py311h92b7b1e_0         160 KB
truststore-0.8.0           |  py311h06a4308_0          43 KB
urllib3-2.1.0              |  py311h06a4308_1         199 KB
zstandard-0.19.0           |  py311h5eee18b_0         438 KB
------------------------------------------------------------
                                       Total:         6.9 MB

The following NEW packages will be INSTALLED:

archspec pkgs/main/noarch::archspec-0.2.3-pyhd3eb1b0_0 boltons pkgs/main/linux-64::boltons-23.0.0-py311h06a4308_0 brotli-python pkgs/main/linux-64::brotli-python-1.0.9-py311h6a678d5_7 c-ares pkgs/main/linux-64::c-ares-1.19.1-h5eee18b_0 certifi pkgs/main/linux-64::certifi-2024.2.2-py311h06a4308_0 cffi pkgs/main/linux-64::cffi-1.16.0-py311h5eee18b_0 charset-normalizer pkgs/main/noarch::charset-normalizer-2.0.4-pyhd3eb1b0_0 conda pkgs/main/linux-64::conda-24.3.0-py311h06a4308_0 conda-libmamba-so~ pkgs/main/noarch::conda-libmamba-solver-24.1.0-pyhd3eb1b0_0 conda-package-han~ pkgs/main/linux-64::conda-package-handling-2.2.0-py311h06a4308_0 conda-package-str~ pkgs/main/linux-64::conda-package-streaming-0.9.0-py311h06a4308_0 distro pkgs/main/linux-64::distro-1.8.0-py311h06a4308_0 fmt pkgs/main/linux-64::fmt-9.1.0-hdb19cb5_0 icu pkgs/main/linux-64::icu-73.1-h6a678d5_0 idna pkgs/main/linux-64::idna-3.4-py311h06a4308_0 jsonpatch pkgs/main/linux-64::jsonpatch-1.33-py311h06a4308_0 jsonpointer pkgs/main/noarch::jsonpointer-2.1-pyhd3eb1b0_0 krb5 pkgs/main/linux-64::krb5-1.20.1-h143b758_1 libarchive pkgs/main/linux-64::libarchive-3.6.2-h6ac8c49_2 libcurl pkgs/main/linux-64::libcurl-8.5.0-h251f7ec_0 libedit pkgs/main/linux-64::libedit-3.1.20230828-h5eee18b_0 libev pkgs/main/linux-64::libev-4.33-h7f8727e_1 libmamba pkgs/main/linux-64::libmamba-1.5.6-haf1ee3a_0 libmambapy pkgs/main/linux-64::libmambapy-1.5.6-py311h2dafd23_0 libnghttp2 pkgs/main/linux-64::libnghttp2-1.57.0-h2d74bed_0 libsolv pkgs/main/linux-64::libsolv-0.7.24-he621ea3_0 libssh2 pkgs/main/linux-64::libssh2-1.10.0-hdbd6064_2 libxml2 pkgs/main/linux-64::libxml2-2.10.4-hf1b16e4_1 lz4-c pkgs/main/linux-64::lz4-c-1.9.4-h6a678d5_0 menuinst pkgs/main/linux-64::menuinst-2.0.2-py311h06a4308_0 packaging pkgs/main/linux-64::packaging-23.2-py311h06a4308_0 pcre2 pkgs/main/linux-64::pcre2-10.42-hebb0a14_0 platformdirs pkgs/main/linux-64::platformdirs-3.10.0-py311h06a4308_0 pluggy pkgs/main/linux-64::pluggy-1.0.0-py311h06a4308_1 pybind11-abi pkgs/main/noarch::pybind11-abi-4-hd3eb1b0_1 pycosat pkgs/main/linux-64::pycosat-0.6.6-py311h5eee18b_0 pycparser pkgs/main/noarch::pycparser-2.21-pyhd3eb1b0_0 pysocks pkgs/main/linux-64::pysocks-1.7.1-py311h06a4308_0 reproc pkgs/main/linux-64::reproc-14.2.4-h295c915_1 reproc-cpp pkgs/main/linux-64::reproc-cpp-14.2.4-h295c915_1 requests pkgs/main/linux-64::requests-2.31.0-py311h06a4308_1 ruamel.yaml pkgs/main/linux-64::ruamel.yaml-0.17.21-py311h5eee18b_0 tqdm pkgs/main/linux-64::tqdm-4.65.0-py311h92b7b1e_0 truststore pkgs/main/linux-64::truststore-0.8.0-py311h06a4308_0 urllib3 pkgs/main/linux-64::urllib3-2.1.0-py311h06a4308_1 yaml-cpp pkgs/main/linux-64::yaml-cpp-0.8.0-h6a678d5_0 zstandard pkgs/main/linux-64::zstandard-0.19.0-py311h5eee18b_0 zstd pkgs/main/linux-64::zstd-1.5.5-hc292b87_0

Downloading and Extracting Packages:

Preparing transaction: done
Verifying transaction: done
Executing transaction: done
Cloning into 'lollms-webui'...
remote: Enumerating objects: 454, done. remote: Counting objects: 100% (454/454), done. remote: Compressing objects: 100% (396/396), done. remote: Total 454 (delta 64), reused 327 (delta 32), pack-reused 0 Receiving objects: 100% (454/454), 7.33 MiB | 9.09 MiB/s, done.
Resolving deltas: 100% (64/64), done.
Submodule 'lollms_core' (https://github.com/ParisNeo/lollms.git) registered for path 'lollms_core'
Submodule 'utilities/safe_store' (https://github.com/ParisNeo/safe_store.git) registered for path 'utilities/safe_store'
Submodule 'zoos/bindings_zoo' (https://github.com/ParisNeo/lollms_bindings_zoo.git) registered for path 'zoos/bindings_zoo'
Submodule 'zoos/extensions_zoo' (https://github.com/ParisNeo/lollms_extensions_zoo.git) registered for path 'zoos/extensions_zoo'
Submodule 'zoos/models_zoo' (https://github.com/ParisNeo/models_zoo.git) registered for path 'zoos/models_zoo'
Submodule 'zoos/personalities_zoo' (https://github.com/ParisNeo/lollms_personalities_zoo.git) registered for path 'zoos/personalities_zoo'
Cloning into '/home/user/AI/lollms/lollms-webui/lollms_core'...
remote: Enumerating objects: 4679, done.
remote: Counting objects: 100% (2470/2470), done.
remote: Compressing objects: 100% (682/682), done.
remote: Total 4679 (delta 1950), reused 1994 (delta 1737), pack-reused 2209
Receiving objects: 100% (4679/4679), 5.16 MiB | 9.05 MiB/s, done. Resolving deltas: 100% (3238/3238), done. Cloning into '/home/user/AI/lollms/lollms-webui/utilities/safe_store'... remote: Enumerating objects: 264, done.
remote: Counting objects: 100% (264/264), done.
remote: Compressing objects: 100% (179/179), done.
remote: Total 264 (delta 161), reused 169 (delta 78), pack-reused 0
Receiving objects: 100% (264/264), 1.02 MiB | 5.23 MiB/s, done. Resolving deltas: 100% (161/161), done. Cloning into '/home/user/AI/lollms/lollms-webui/zoos/bindings_zoo'... remote: Enumerating objects: 3881, done.
remote: Counting objects: 100% (2823/2823), done.
remote: Compressing objects: 100% (831/831), done.
remote: Total 3881 (delta 2136), reused 2396 (delta 1979), pack-reused 1058
Receiving objects: 100% (3881/3881), 11.69 MiB | 8.91 MiB/s, done. Resolving deltas: 100% (2881/2881), done. Cloning into '/home/user/AI/lollms/lollms-webui/zoos/extensions_zoo'... remote: Enumerating objects: 149, done.
remote: Counting objects: 100% (149/149), done.
remote: Compressing objects: 100% (88/88), done.
remote: Total 149 (delta 67), reused 104 (delta 34), pack-reused 0
Receiving objects: 100% (149/149), 937.29 KiB | 4.53 MiB/s, done. Resolving deltas: 100% (67/67), done. Cloning into '/home/user/AI/lollms/lollms-webui/zoos/models_zoo'... remote: Enumerating objects: 410, done.
remote: Counting objects: 100% (184/184), done.
remote: Compressing objects: 100% (118/118), done.
remote: Total 410 (delta 135), reused 111 (delta 66), pack-reused 226
Receiving objects: 100% (410/410), 2.27 MiB | 6.96 MiB/s, done. Resolving deltas: 100% (284/284), done. Cloning into '/home/user/AI/lollms/lollms-webui/zoos/personalities_zoo'... remote: Enumerating objects: 8757, done.
remote: Counting objects: 100% (4427/4427), done.
remote: Compressing objects: 100% (1380/1380), done.
remote: Total 8757 (delta 2599), reused 4210 (delta 2486), pack-reused 4330
Receiving objects: 100% (8757/8757), 95.28 MiB | 10.86 MiB/s, done. Resolving deltas: 100% (4298/4298), done. Submodule path 'lollms_core': checked out '2209934b94bfd755ef39d67d98c6517d4f00308f' Submodule path 'utilities/safe_store': checked out 'c5bd2831ba32b6e29429fc40bcc847956c2c2ff0' Submodule path 'zoos/bindings_zoo': checked out '27af1f9f69f2ab89c0a4c7742aaeb9bb6eb159a5' Submodule path 'zoos/extensions_zoo': checked out '4107557398450addb7500e06d80f26b37f572805' Submodule path 'zoos/models_zoo': checked out 'b9423ea479484a0f927bc9c27d4060cca71d4200' Submodule path 'zoos/personalities_zoo': checked out '73bad1838de1bb65f491dbfc75b0f53610133999' fatal: not a git repository (or any of the parent directories): .git Obtaining file:///home/user/AI/lollms/lollms-webui/lollms_core Preparing metadata (setup.py) ... done Requirement already satisfied: tqdm in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from lollms==9.4.0) (4.65.0) Collecting pyyaml (from lollms==9.4.0) Using cached PyYAML-6.0.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB) Collecting Pillow (from lollms==9.4.0) Using cached pillow-10.2.0-cp311-cp311-manylinux_2_28_x86_64.whl.metadata (9.7 kB) Collecting wget (from lollms==9.4.0) Using cached wget-3.2-py3-none-any.whl Requirement already satisfied: setuptools in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from lollms==9.4.0) (68.2.2) Requirement already satisfied: requests in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from lollms==9.4.0) (2.31.0) Collecting safe_store (from lollms==9.4.0) Using cached safe_store-0.4.0-py3-none-any.whl.metadata (7.4 kB) Collecting ascii_colors>=0.1.3 (from lollms==9.4.0) Using cached ascii_colors-0.2.2-py3-none-any.whl.metadata (922 bytes) Collecting autopep8 (from lollms==9.4.0) Using cached autopep8-2.1.0-py2.py3-none-any.whl.metadata (16 kB) Collecting fastapi (from lollms==9.4.0) Using cached fastapi-0.110.0-py3-none-any.whl.metadata (25 kB) Collecting uvicorn (from lollms==9.4.0) Using cached uvicorn-0.29.0-py3-none-any.whl.metadata (6.3 kB) Collecting python-multipart (from lollms==9.4.0) Using cached python_multipart-0.0.9-py3-none-any.whl.metadata (2.5 kB) Collecting python-socketio (from lollms==9.4.0) Downloading python_socketio-5.11.2-py3-none-any.whl.metadata (3.2 kB) Collecting pycodestyle>=2.11.0 (from autopep8->lollms==9.4.0) Using cached pycodestyle-2.11.1-py2.py3-none-any.whl.metadata (4.5 kB) Collecting pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4 (from fastapi->lollms==9.4.0) Using cached pydantic-2.6.4-py3-none-any.whl.metadata (85 kB) Collecting starlette<0.37.0,>=0.36.3 (from fastapi->lollms==9.4.0) Using cached starlette-0.36.3-py3-none-any.whl.metadata (5.9 kB) Collecting typing-extensions>=4.8.0 (from fastapi->lollms==9.4.0) Using cached typing_extensions-4.10.0-py3-none-any.whl.metadata (3.0 kB) Collecting bidict>=0.21.0 (from python-socketio->lollms==9.4.0) Using cached bidict-0.23.1-py3-none-any.whl.metadata (8.7 kB) Collecting python-engineio>=4.8.0 (from python-socketio->lollms==9.4.0) Using cached python_engineio-4.9.0-py3-none-any.whl.metadata (2.2 kB) Collecting aiohttp>=3.4 (from python-socketio[asyncio_client]->lollms==9.4.0) Using cached aiohttp-3.9.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.4 kB) Collecting websocket-client>=0.54.0 (from python-socketio[client]->lollms==9.4.0) Using cached websocket_client-1.7.0-py3-none-any.whl.metadata (7.9 kB) Requirement already satisfied: charset-normalizer<4,>=2 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from requests->lollms==9.4.0) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from requests->lollms==9.4.0) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from requests->lollms==9.4.0) (2.1.0) Requirement already satisfied: certifi>=2017.4.17 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from requests->lollms==9.4.0) (2024.2.2) Collecting scikit-learn (from safe_store->lollms==9.4.0) Using cached scikit_learn-1.4.1.post1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB) Collecting matplotlib (from safe_store->lollms==9.4.0) Using cached matplotlib-3.8.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.8 kB) Collecting seaborn (from safe_store->lollms==9.4.0) Using cached seaborn-0.13.2-py3-none-any.whl.metadata (5.4 kB) Collecting python-docx (from safe_store->lollms==9.4.0) Using cached python_docx-1.1.0-py3-none-any.whl.metadata (2.0 kB) Collecting python-pptx (from safe_store->lollms==9.4.0) Using cached python_pptx-0.6.23-py3-none-any.whl.metadata (18 kB) Collecting pandas (from safe_store->lollms==9.4.0) Using cached pandas-2.2.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (19 kB) Collecting beautifulsoup4 (from safe_store->lollms==9.4.0) Using cached beautifulsoup4-4.12.3-py3-none-any.whl.metadata (3.8 kB) Collecting mplcursors (from safe_store->lollms==9.4.0) Using cached mplcursors-0.5.3-py3-none-any.whl Collecting PyPDF2 (from safe_store->lollms==9.4.0) Using cached pypdf2-3.0.1-py3-none-any.whl.metadata (6.8 kB) Collecting dpkt (from safe_store->lollms==9.4.0) Using cached dpkt-1.9.8-py3-none-any.whl.metadata (1.7 kB) Collecting transformers (from safe_store->lollms==9.4.0) Using cached transformers-4.39.1-py3-none-any.whl.metadata (134 kB) Collecting click>=7.0 (from uvicorn->lollms==9.4.0) Using cached click-8.1.7-py3-none-any.whl.metadata (3.0 kB) Collecting h11>=0.8 (from uvicorn->lollms==9.4.0) Using cached h11-0.14.0-py3-none-any.whl.metadata (8.2 kB) Collecting aiosignal>=1.1.2 (from aiohttp>=3.4->python-socketio[asyncio_client]->lollms==9.4.0) Using cached aiosignal-1.3.1-py3-none-any.whl.metadata (4.0 kB) Collecting attrs>=17.3.0 (from aiohttp>=3.4->python-socketio[asyncio_client]->lollms==9.4.0) Using cached attrs-23.2.0-py3-none-any.whl.metadata (9.5 kB) Collecting frozenlist>=1.1.1 (from aiohttp>=3.4->python-socketio[asyncio_client]->lollms==9.4.0) Using cached frozenlist-1.4.1-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (12 kB) Collecting multidict<7.0,>=4.5 (from aiohttp>=3.4->python-socketio[asyncio_client]->lollms==9.4.0) Using cached multidict-6.0.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.2 kB) Collecting yarl<2.0,>=1.0 (from aiohttp>=3.4->python-socketio[asyncio_client]->lollms==9.4.0) Using cached yarl-1.9.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (31 kB) Collecting annotated-types>=0.4.0 (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4->fastapi->lollms==9.4.0) Using cached annotated_types-0.6.0-py3-none-any.whl.metadata (12 kB) Collecting pydantic-core==2.16.3 (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4->fastapi->lollms==9.4.0) Using cached pydantic_core-2.16.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.5 kB) Collecting simple-websocket>=0.10.0 (from python-engineio>=4.8.0->python-socketio->lollms==9.4.0) Using cached simple_websocket-1.0.0-py3-none-any.whl.metadata (1.3 kB) Collecting anyio<5,>=3.4.0 (from starlette<0.37.0,>=0.36.3->fastapi->lollms==9.4.0) Using cached anyio-4.3.0-py3-none-any.whl.metadata (4.6 kB) Collecting soupsieve>1.2 (from beautifulsoup4->safe_store->lollms==9.4.0) Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB) Collecting contourpy>=1.0.1 (from matplotlib->safe_store->lollms==9.4.0) Using cached contourpy-1.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.8 kB) Collecting cycler>=0.10 (from matplotlib->safe_store->lollms==9.4.0) Using cached cycler-0.12.1-py3-none-any.whl.metadata (3.8 kB) Collecting fonttools>=4.22.0 (from matplotlib->safe_store->lollms==9.4.0) Using cached fonttools-4.50.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (159 kB) Collecting kiwisolver>=1.3.1 (from matplotlib->safe_store->lollms==9.4.0) Using cached kiwisolver-1.4.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.4 kB) Collecting numpy<2,>=1.21 (from matplotlib->safe_store->lollms==9.4.0) Using cached numpy-1.26.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (61 kB) Requirement already satisfied: packaging>=20.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from matplotlib->safe_store->lollms==9.4.0) (23.2) Collecting pyparsing>=2.3.1 (from matplotlib->safe_store->lollms==9.4.0) Using cached pyparsing-3.1.2-py3-none-any.whl.metadata (5.1 kB) Collecting python-dateutil>=2.7 (from matplotlib->safe_store->lollms==9.4.0) Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) Collecting pytz>=2020.1 (from pandas->safe_store->lollms==9.4.0) Using cached pytz-2024.1-py2.py3-none-any.whl.metadata (22 kB) Collecting tzdata>=2022.7 (from pandas->safe_store->lollms==9.4.0) Using cached tzdata-2024.1-py2.py3-none-any.whl.metadata (1.4 kB) Collecting lxml>=3.1.0 (from python-docx->safe_store->lollms==9.4.0) Using cached lxml-5.1.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.5 kB) Collecting XlsxWriter>=0.5.7 (from python-pptx->safe_store->lollms==9.4.0) Using cached XlsxWriter-3.2.0-py3-none-any.whl.metadata (2.6 kB) Collecting scipy>=1.6.0 (from scikit-learn->safe_store->lollms==9.4.0) Using cached scipy-1.12.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (60 kB) Collecting joblib>=1.2.0 (from scikit-learn->safe_store->lollms==9.4.0) Using cached joblib-1.3.2-py3-none-any.whl.metadata (5.4 kB) Collecting threadpoolctl>=2.0.0 (from scikit-learn->safe_store->lollms==9.4.0) Using cached threadpoolctl-3.4.0-py3-none-any.whl.metadata (13 kB) Collecting filelock (from transformers->safe_store->lollms==9.4.0) Using cached filelock-3.13.1-py3-none-any.whl.metadata (2.8 kB) Collecting huggingface-hub<1.0,>=0.19.3 (from transformers->safe_store->lollms==9.4.0) Using cached huggingface_hub-0.21.4-py3-none-any.whl.metadata (13 kB) Collecting regex!=2019.12.17 (from transformers->safe_store->lollms==9.4.0) Using cached regex-2023.12.25-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (40 kB) Collecting tokenizers<0.19,>=0.14 (from transformers->safe_store->lollms==9.4.0) Using cached tokenizers-0.15.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.7 kB) Collecting safetensors>=0.4.1 (from transformers->safe_store->lollms==9.4.0) Using cached safetensors-0.4.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.8 kB) Collecting sniffio>=1.1 (from anyio<5,>=3.4.0->starlette<0.37.0,>=0.36.3->fastapi->lollms==9.4.0) Using cached sniffio-1.3.1-py3-none-any.whl.metadata (3.9 kB) Collecting fsspec>=2023.5.0 (from huggingface-hub<1.0,>=0.19.3->transformers->safe_store->lollms==9.4.0) Using cached fsspec-2024.3.1-py3-none-any.whl.metadata (6.8 kB) Collecting six>=1.5 (from python-dateutil>=2.7->matplotlib->safe_store->lollms==9.4.0) Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) Collecting wsproto (from simple-websocket>=0.10.0->python-engineio>=4.8.0->python-socketio->lollms==9.4.0) Using cached wsproto-1.2.0-py3-none-any.whl.metadata (5.6 kB) Using cached ascii_colors-0.2.2-py3-none-any.whl (7.5 kB) Using cached autopep8-2.1.0-py2.py3-none-any.whl (44 kB) Using cached fastapi-0.110.0-py3-none-any.whl (92 kB) Using cached pillow-10.2.0-cp311-cp311-manylinux_2_28_x86_64.whl (4.5 MB) Using cached python_multipart-0.0.9-py3-none-any.whl (22 kB) Downloading python_socketio-5.11.2-py3-none-any.whl (75 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━ 75.7/75.7 kB 2.1 MB/s eta 0:00:00 Using cached PyYAML-6.0.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (757 kB) Using cached safe_store-0.4.0-py3-none-any.whl (21 kB) Using cached uvicorn-0.29.0-py3-none-any.whl (60 kB) Using cached aiohttp-3.9.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) Using cached bidict-0.23.1-py3-none-any.whl (32 kB) Using cached click-8.1.7-py3-none-any.whl (97 kB) Using cached h11-0.14.0-py3-none-any.whl (58 kB) Using cached pycodestyle-2.11.1-py2.py3-none-any.whl (31 kB) Using cached pydantic-2.6.4-py3-none-any.whl (394 kB) Using cached pydantic_core-2.16.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.2 MB) Using cached python_engineio-4.9.0-py3-none-any.whl (57 kB) Using cached starlette-0.36.3-py3-none-any.whl (71 kB) Using cached typing_extensions-4.10.0-py3-none-any.whl (33 kB) Using cached websocket_client-1.7.0-py3-none-any.whl (58 kB) Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB) Using cached dpkt-1.9.8-py3-none-any.whl (194 kB) Using cached matplotlib-3.8.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.6 MB) Using cached pandas-2.2.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (13.0 MB) Using cached pypdf2-3.0.1-py3-none-any.whl (232 kB) Using cached python_docx-1.1.0-py3-none-any.whl (239 kB) Using cached python_pptx-0.6.23-py3-none-any.whl (471 kB) Using cached scikit_learn-1.4.1.post1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.1 MB) Using cached seaborn-0.13.2-py3-none-any.whl (294 kB) Using cached transformers-4.39.1-py3-none-any.whl (8.8 MB) Using cached aiosignal-1.3.1-py3-none-any.whl (7.6 kB) Using cached annotated_types-0.6.0-py3-none-any.whl (12 kB) Using cached anyio-4.3.0-py3-none-any.whl (85 kB) Using cached attrs-23.2.0-py3-none-any.whl (60 kB) Using cached contourpy-1.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (313 kB) Using cached cycler-0.12.1-py3-none-any.whl (8.3 kB) Using cached fonttools-4.50.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.9 MB) Using cached frozenlist-1.4.1-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (272 kB) Using cached huggingface_hub-0.21.4-py3-none-any.whl (346 kB) Using cached joblib-1.3.2-py3-none-any.whl (302 kB) Using cached kiwisolver-1.4.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.4 MB) Using cached lxml-5.1.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (8.1 MB) Using cached multidict-6.0.5-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (128 kB) Using cached numpy-1.26.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (18.3 MB) Using cached pyparsing-3.1.2-py3-none-any.whl (103 kB) Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) Using cached pytz-2024.1-py2.py3-none-any.whl (505 kB) Using cached regex-2023.12.25-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (785 kB) Using cached safetensors-0.4.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) Using cached scipy-1.12.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (38.4 MB) Using cached simple_websocket-1.0.0-py3-none-any.whl (13 kB) Using cached soupsieve-2.5-py3-none-any.whl (36 kB) Using cached threadpoolctl-3.4.0-py3-none-any.whl (17 kB) Using cached tokenizers-0.15.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.6 MB) Using cached tzdata-2024.1-py2.py3-none-any.whl (345 kB) Using cached XlsxWriter-3.2.0-py3-none-any.whl (159 kB) Using cached yarl-1.9.4-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (328 kB) Using cached filelock-3.13.1-py3-none-any.whl (11 kB) Using cached fsspec-2024.3.1-py3-none-any.whl (171 kB) Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) Using cached sniffio-1.3.1-py3-none-any.whl (10 kB) Using cached wsproto-1.2.0-py3-none-any.whl (24 kB) Installing collected packages: wget, pytz, dpkt, XlsxWriter, websocket-client, tzdata, typing-extensions, threadpoolctl, soupsieve, sniffio, six, safetensors, regex, pyyaml, python-multipart, PyPDF2, pyparsing, pycodestyle, Pillow, numpy, multidict, lxml, kiwisolver, joblib, h11, fsspec, frozenlist, fonttools, filelock, cycler, click, bidict, attrs, ascii_colors, annotated-types, yarl, wsproto, uvicorn, scipy, python-pptx, python-docx, python-dateutil, pydantic-core, huggingface-hub, contourpy, beautifulsoup4, autopep8, anyio, aiosignal, tokenizers, starlette, simple-websocket, scikit-learn, pydantic, pandas, matplotlib, aiohttp, transformers, seaborn, python-engineio, mplcursors, fastapi, safe_store, python-socketio, lollms Running setup.py develop for lollms Successfully installed Pillow-10.2.0 PyPDF2-3.0.1 XlsxWriter-3.2.0 aiohttp-3.9.3 aiosignal-1.3.1 annotated-types-0.6.0 anyio-4.3.0 ascii_colors-0.2.2 attrs-23.2.0 autopep8-2.1.0 beautifulsoup4-4.12.3 bidict-0.23.1 click-8.1.7 contourpy-1.2.0 cycler-0.12.1 dpkt-1.9.8 fastapi-0.110.0 filelock-3.13.1 fonttools-4.50.0 frozenlist-1.4.1 fsspec-2024.3.1 h11-0.14.0 huggingface-hub-0.21.4 joblib-1.3.2 kiwisolver-1.4.5 lollms-9.4.0 lxml-5.1.0 matplotlib-3.8.3 mplcursors-0.5.3 multidict-6.0.5 numpy-1.26.4 pandas-2.2.1 pycodestyle-2.11.1 pydantic-2.6.4 pydantic-core-2.16.3 pyparsing-3.1.2 python-dateutil-2.9.0.post0 python-docx-1.1.0 python-engineio-4.9.0 python-multipart-0.0.9 python-pptx-0.6.23 python-socketio-5.11.2 pytz-2024.1 pyyaml-6.0.1 regex-2023.12.25 safe_store-0.4.0 safetensors-0.4.2 scikit-learn-1.4.1.post1 scipy-1.12.0 seaborn-0.13.2 simple-websocket-1.0.0 six-1.16.0 sniffio-1.3.1 soupsieve-2.5 starlette-0.36.3 threadpoolctl-3.4.0 tokenizers-0.15.2 transformers-4.39.1 typing-extensions-4.10.0 tzdata-2024.1 uvicorn-0.29.0 websocket-client-1.7.0 wget-3.2 wsproto-1.2.0 yarl-1.9.4 Obtaining file:///home/user/AI/lollms/lollms-webui/utilities/safe_store Preparing metadata (setup.py) ... done Requirement already satisfied: scikit-learn in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from safe-store==0.5.0) (1.4.1.post1) Requirement already satisfied: ascii_colors in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from safe-store==0.5.0) (0.2.2) Requirement already satisfied: matplotlib in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from safe-store==0.5.0) (3.8.3) Requirement already satisfied: seaborn in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from safe-store==0.5.0) (0.13.2) Requirement already satisfied: python-docx in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from safe-store==0.5.0) (1.1.0) Requirement already satisfied: python-pptx in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from safe-store==0.5.0) (0.6.23) Requirement already satisfied: pandas in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from safe-store==0.5.0) (2.2.1) Requirement already satisfied: beautifulsoup4 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from safe-store==0.5.0) (4.12.3) Requirement already satisfied: mplcursors in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from safe-store==0.5.0) (0.5.3) Requirement already satisfied: PyPDF2 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from safe-store==0.5.0) (3.0.1) Requirement already satisfied: dpkt in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from safe-store==0.5.0) (1.9.8) Requirement already satisfied: soupsieve>1.2 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from beautifulsoup4->safe-store==0.5.0) (2.5) Requirement already satisfied: contourpy>=1.0.1 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from matplotlib->safe-store==0.5.0) (1.2.0) Requirement already satisfied: cycler>=0.10 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from matplotlib->safe-store==0.5.0) (0.12.1) Requirement already satisfied: fonttools>=4.22.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from matplotlib->safe-store==0.5.0) (4.50.0) Requirement already satisfied: kiwisolver>=1.3.1 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from matplotlib->safe-store==0.5.0) (1.4.5) Requirement already satisfied: numpy<2,>=1.21 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from matplotlib->safe-store==0.5.0) (1.26.4) Requirement already satisfied: packaging>=20.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from matplotlib->safe-store==0.5.0) (23.2) Requirement already satisfied: pillow>=8 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from matplotlib->safe-store==0.5.0) (10.2.0) Requirement already satisfied: pyparsing>=2.3.1 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from matplotlib->safe-store==0.5.0) (3.1.2) Requirement already satisfied: python-dateutil>=2.7 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from matplotlib->safe-store==0.5.0) (2.9.0.post0) Requirement already satisfied: pytz>=2020.1 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from pandas->safe-store==0.5.0) (2024.1) Requirement already satisfied: tzdata>=2022.7 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from pandas->safe-store==0.5.0) (2024.1) Requirement already satisfied: lxml>=3.1.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from python-docx->safe-store==0.5.0) (5.1.0) Requirement already satisfied: typing-extensions in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from python-docx->safe-store==0.5.0) (4.10.0) Requirement already satisfied: XlsxWriter>=0.5.7 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from python-pptx->safe-store==0.5.0) (3.2.0) Requirement already satisfied: scipy>=1.6.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from scikit-learn->safe-store==0.5.0) (1.12.0) Requirement already satisfied: joblib>=1.2.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from scikit-learn->safe-store==0.5.0) (1.3.2) Requirement already satisfied: threadpoolctl>=2.0.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from scikit-learn->safe-store==0.5.0) (3.4.0) Requirement already satisfied: six>=1.5 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from python-dateutil>=2.7->matplotlib->safe-store==0.5.0) (1.16.0) Installing collected packages: safe-store Attempting uninstall: safe-store Found existing installation: safe-store 0.4.0 Uninstalling safe-store-0.4.0: Successfully uninstalled safe-store-0.4.0 Running setup.py develop for safe-store Successfully installed safe-store-0.5.0 Collecting colorama (from -r requirements.txt (line 1)) Using cached colorama-0.4.6-py2.py3-none-any.whl.metadata (17 kB) Requirement already satisfied: numpy==1.26.* in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 2)) (1.26.4) Requirement already satisfied: pandas in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 3)) (2.2.1) Requirement already satisfied: Pillow>=9.5.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 4)) (10.2.0) Requirement already satisfied: pyyaml in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 5)) (6.0.1) Requirement already satisfied: requests in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 6)) (2.31.0) Collecting rich (from -r requirements.txt (line 7)) Using cached rich-13.7.1-py3-none-any.whl.metadata (18 kB) Requirement already satisfied: scipy in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 8)) (1.12.0) Requirement already satisfied: tqdm in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 9)) (4.65.0) Collecting tqdm (from -r requirements.txt (line 9)) Using cached tqdm-4.66.2-py3-none-any.whl.metadata (57 kB) Requirement already satisfied: setuptools in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 10)) (68.2.2) Collecting setuptools (from -r requirements.txt (line 10)) Using cached setuptools-69.2.0-py3-none-any.whl.metadata (6.3 kB) Collecting psutil (from -r requirements.txt (line 11)) Using cached psutil-5.9.8-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (21 kB) Collecting pytest (from -r requirements.txt (line 12)) Using cached pytest-8.1.1-py3-none-any.whl.metadata (7.6 kB) Collecting GitPython (from -r requirements.txt (line 13)) Using cached GitPython-3.1.42-py3-none-any.whl.metadata (12 kB) Requirement already satisfied: ascii_colors>=0.1.4 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 14)) (0.2.2) Requirement already satisfied: beautifulsoup4 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 15)) (4.12.3) Requirement already satisfied: packaging in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 16)) (23.2) Collecting packaging (from -r requirements.txt (line 16)) Using cached packaging-24.0-py3-none-any.whl.metadata (3.2 kB) Requirement already satisfied: fastapi in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 18)) (0.110.0) Requirement already satisfied: uvicorn in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 19)) (0.29.0) Requirement already satisfied: python-multipart in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 20)) (0.0.9) Requirement already satisfied: python-socketio in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 21)) (5.11.2) Requirement already satisfied: pydantic in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r requirements.txt (line 25)) (2.6.4) Collecting selenium (from -r requirements.txt (line 26)) Using cached selenium-4.18.1-py3-none-any.whl.metadata (6.9 kB) Collecting tiktoken (from -r requirements.txt (line 27)) Using cached tiktoken-0.6.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.6 kB) Requirement already satisfied: python-dateutil>=2.8.2 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from pandas->-r requirements.txt (line 3)) (2.9.0.post0) Requirement already satisfied: pytz>=2020.1 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from pandas->-r requirements.txt (line 3)) (2024.1) Requirement already satisfied: tzdata>=2022.7 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from pandas->-r requirements.txt (line 3)) (2024.1) Requirement already satisfied: charset-normalizer<4,>=2 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from requests->-r requirements.txt (line 6)) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from requests->-r requirements.txt (line 6)) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from requests->-r requirements.txt (line 6)) (2.1.0) Requirement already satisfied: certifi>=2017.4.17 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from requests->-r requirements.txt (line 6)) (2024.2.2) Collecting markdown-it-py>=2.2.0 (from rich->-r requirements.txt (line 7)) Using cached markdown_it_py-3.0.0-py3-none-any.whl.metadata (6.9 kB) Collecting pygments<3.0.0,>=2.13.0 (from rich->-r requirements.txt (line 7)) Using cached pygments-2.17.2-py3-none-any.whl.metadata (2.6 kB) Collecting iniconfig (from pytest->-r requirements.txt (line 12)) Using cached iniconfig-2.0.0-py3-none-any.whl.metadata (2.6 kB) Collecting pluggy<2.0,>=1.4 (from pytest->-r requirements.txt (line 12)) Using cached pluggy-1.4.0-py3-none-any.whl.metadata (4.3 kB) Collecting gitdb<5,>=4.0.1 (from GitPython->-r requirements.txt (line 13)) Using cached gitdb-4.0.11-py3-none-any.whl.metadata (1.2 kB) Requirement already satisfied: soupsieve>1.2 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from beautifulsoup4->-r requirements.txt (line 15)) (2.5) Requirement already satisfied: starlette<0.37.0,>=0.36.3 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from fastapi->-r requirements.txt (line 18)) (0.36.3) Requirement already satisfied: typing-extensions>=4.8.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from fastapi->-r requirements.txt (line 18)) (4.10.0) Requirement already satisfied: click>=7.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from uvicorn->-r requirements.txt (line 19)) (8.1.7) Requirement already satisfied: h11>=0.8 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from uvicorn->-r requirements.txt (line 19)) (0.14.0) Requirement already satisfied: bidict>=0.21.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from python-socketio->-r requirements.txt (line 21)) (0.23.1) Requirement already satisfied: python-engineio>=4.8.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from python-socketio->-r requirements.txt (line 21)) (4.9.0) Requirement already satisfied: websocket-client>=0.54.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from python-socketio[client]->-r requirements.txt (line 22)) (1.7.0) Requirement already satisfied: aiohttp>=3.4 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from python-socketio[asyncio_client]->-r requirements.txt (line 23)) (3.9.3) Requirement already satisfied: annotated-types>=0.4.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from pydantic->-r requirements.txt (line 25)) (0.6.0) Requirement already satisfied: pydantic-core==2.16.3 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from pydantic->-r requirements.txt (line 25)) (2.16.3) Collecting trio~=0.17 (from selenium->-r requirements.txt (line 26)) Using cached trio-0.25.0-py3-none-any.whl.metadata (8.7 kB) Collecting trio-websocket~=0.9 (from selenium->-r requirements.txt (line 26)) Using cached trio_websocket-0.11.1-py3-none-any.whl.metadata (4.7 kB) Requirement already satisfied: regex>=2022.1.18 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from tiktoken->-r requirements.txt (line 27)) (2023.12.25) Requirement already satisfied: aiosignal>=1.1.2 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from aiohttp>=3.4->python-socketio[asyncio_client]->-r requirements.txt (line 23)) (1.3.1) Requirement already satisfied: attrs>=17.3.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from aiohttp>=3.4->python-socketio[asyncio_client]->-r requirements.txt (line 23)) (23.2.0) Requirement already satisfied: frozenlist>=1.1.1 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from aiohttp>=3.4->python-socketio[asyncio_client]->-r requirements.txt (line 23)) (1.4.1) Requirement already satisfied: multidict<7.0,>=4.5 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from aiohttp>=3.4->python-socketio[asyncio_client]->-r requirements.txt (line 23)) (6.0.5) Requirement already satisfied: yarl<2.0,>=1.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from aiohttp>=3.4->python-socketio[asyncio_client]->-r requirements.txt (line 23)) (1.9.4) Collecting smmap<6,>=3.0.1 (from gitdb<5,>=4.0.1->GitPython->-r requirements.txt (line 13)) Using cached smmap-5.0.1-py3-none-any.whl.metadata (4.3 kB) Collecting mdurl~=0.1 (from markdown-it-py>=2.2.0->rich->-r requirements.txt (line 7)) Using cached mdurl-0.1.2-py3-none-any.whl.metadata (1.6 kB) Requirement already satisfied: six>=1.5 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from python-dateutil>=2.8.2->pandas->-r requirements.txt (line 3)) (1.16.0) Requirement already satisfied: simple-websocket>=0.10.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from python-engineio>=4.8.0->python-socketio->-r requirements.txt (line 21)) (1.0.0) Requirement already satisfied: anyio<5,>=3.4.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from starlette<0.37.0,>=0.36.3->fastapi->-r requirements.txt (line 18)) (4.3.0) Collecting sortedcontainers (from trio~=0.17->selenium->-r requirements.txt (line 26)) Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl.metadata (10 kB) Collecting outcome (from trio~=0.17->selenium->-r requirements.txt (line 26)) Using cached outcome-1.3.0.post0-py2.py3-none-any.whl.metadata (2.6 kB) Requirement already satisfied: sniffio>=1.3.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from trio~=0.17->selenium->-r requirements.txt (line 26)) (1.3.1) Requirement already satisfied: wsproto>=0.14 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from trio-websocket~=0.9->selenium->-r requirements.txt (line 26)) (1.2.0) Requirement already satisfied: pysocks!=1.5.7,<2.0,>=1.5.6 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from urllib3[socks]<3,>=1.26->selenium->-r requirements.txt (line 26)) (1.7.1) Using cached colorama-0.4.6-py2.py3-none-any.whl (25 kB) Using cached rich-13.7.1-py3-none-any.whl (240 kB) Using cached tqdm-4.66.2-py3-none-any.whl (78 kB) Using cached setuptools-69.2.0-py3-none-any.whl (821 kB) Using cached psutil-5.9.8-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (288 kB) Using cached pytest-8.1.1-py3-none-any.whl (337 kB) Using cached GitPython-3.1.42-py3-none-any.whl (195 kB) Using cached packaging-24.0-py3-none-any.whl (53 kB) Using cached selenium-4.18.1-py3-none-any.whl (10.0 MB) Using cached tiktoken-0.6.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.8 MB) Using cached gitdb-4.0.11-py3-none-any.whl (62 kB) Using cached markdown_it_py-3.0.0-py3-none-any.whl (87 kB) Using cached pluggy-1.4.0-py3-none-any.whl (20 kB) Using cached pygments-2.17.2-py3-none-any.whl (1.2 MB) Using cached trio-0.25.0-py3-none-any.whl (467 kB) Using cached trio_websocket-0.11.1-py3-none-any.whl (17 kB) Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB) Using cached mdurl-0.1.2-py3-none-any.whl (10.0 kB) Using cached smmap-5.0.1-py3-none-any.whl (24 kB) Using cached outcome-1.3.0.post0-py2.py3-none-any.whl (10 kB) Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB) Installing collected packages: sortedcontainers, tqdm, smmap, setuptools, pygments, psutil, pluggy, packaging, outcome, mdurl, iniconfig, colorama, trio, tiktoken, pytest, markdown-it-py, gitdb, trio-websocket, rich, GitPython, selenium Attempting uninstall: tqdm Found existing installation: tqdm 4.65.0 Uninstalling tqdm-4.65.0: Successfully uninstalled tqdm-4.65.0 Attempting uninstall: setuptools Found existing installation: setuptools 68.2.2 Uninstalling setuptools-68.2.2: Successfully uninstalled setuptools-68.2.2 Attempting uninstall: pluggy Found existing installation: pluggy 1.0.0 Uninstalling pluggy-1.0.0: Successfully uninstalled pluggy-1.0.0 Attempting uninstall: packaging Found existing installation: packaging 23.2 Uninstalling packaging-23.2: Successfully uninstalled packaging-23.2 Successfully installed GitPython-3.1.42 colorama-0.4.6 gitdb-4.0.11 iniconfig-2.0.0 markdown-it-py-3.0.0 mdurl-0.1.2 outcome-1.3.0.post0 packaging-24.0 pluggy-1.4.0 psutil-5.9.8 pygments-2.17.2 pytest-8.1.1 rich-13.7.1 selenium-4.18.1 setuptools-69.2.0 smmap-5.0.1 sortedcontainers-2.4.0 tiktoken-0.6.0 tqdm-4.66.2 trio-0.25.0 trio-websocket-0.11.1 Creating a bin dir (required for llamacpp binding)

_### Trying to use Configuration at :global_paths_cfg.yaml global_pathscfg.yaml not found! Searching in your home folder.

Welcome! It seems this is your first use of the new lollms app. To make it clear where your data are stored, we now give the user the choice where to put its data. This allows you to mutualize models which are heavy, between multiple lollms compatible apps. You can change this at any time using the lollms-settings script or by simply change the content of the global_paths_cfg.yaml file. Please provide a folder to store your configurations files, your models and your personal data (database, custom personalities etc). Folder path: (../personal_data):../personal_data Selected: ../personal_data Execution path : /home/user/AI/lollms/lollms-webui Local zoos folder found ----------------------Paths information----------------------- personal_path:/home/user/AI/lollms/personal_data personal_configuration_path:/home/user/AI/lollms/personal_data/configs personal_discussions_path:/home/user/AI/lollms/personal_data/discussion_databases personal_skills_path:/home/user/AI/lollms/personal_data/skill_databases personal_models_path:/home/user/AI/lollms/personal_data/models personal_user_infos_path:/home/user/AI/lollms/personal_data/user_infos personal_trainers_path:/home/user/AI/lollms/personal_data/trainers personal_trainers_path:/home/user/AI/lollms/personal_data/trainers/gptqlora personal_data_path:/home/user/AI/lollms/personal_data/data custom_personalities_path:/home/user/AI/lollms/personal_data/custom_personalities custom_voices_path:/home/user/AI/lollms/personal_data/custom_voices

----------------------Zoo information----------------------- bindings_zoo_path:/home/user/AI/lollms/lollms-webui/zoos/bindings_zoo personalities_zoo_path:/home/user/AI/lollms/lollms-webui/zoos/personalities_zoo extensions_zoo_path:/home/user/AI/lollms/lollms-webui/zoos/extensions_zoo models_zoo_path:/home/user/AI/lollms/lollms-webui/zoos/models_zoo

Lollms_core found in the app space. Pulling last lollms_core Already up to date. safe_store_path found in the app space. Pulling last safe_store_path Already up to date. Bindings zoo found in your personal space. Pulling last bindings zoo Already up to date. Personalities zoo found in your personal space. Pulling last personalities zoo Updating 73bad18..4fd3a57 Fast-forward internet/internet_scraper/scripts/processor.py | 9 +++++++-- 1 file changed, 7 insertions(+), 2 deletions(-) Extensions zoo found in your personal space. Pulling last Extensions zoo Already up to date. Models zoo found in your personal space. Pulling last Models zoo Already up to date. No binding selected Personality lollms mounted successfully but no model is selected Installing Binding Freeing memory... freeing memory The variable 'model' does not exist in the instance. The variable 'AutoModelForCausalLM' does not exist in the local or global namespace. freed memory ---------------------- Installing bs_exllamav2 ---------------------- Do you prefer compiling the exllama repository from source or use the precompiled version? Press yes if you want to compile from source. (yes/no): yes Cloning exllama git repository Repository was cloned successfully Installing requirements for hardware configuration nvidia-tensorcores Installing cuda 12.3.2 Channels:

Package Plan

environment location: /home/user/AI/lollms/installer_files/lollms_env

added / updated specs:

The following packages will be downloaded:

package                    |            build
---------------------------|-----------------
_libgcc_mutex-0.1          |      conda_forge           3 KB  conda-forge
_openmp_mutex-4.5          |            2_gnu          23 KB  conda-forge
certifi-2024.2.2           |     pyhd8ed1ab_0         157 KB  conda-forge
cuda-cccl-12.3.101         |                0         1.4 MB  nvidia/label/cuda-12.3.2
cuda-command-line-tools-12.3.2|                0           2 KB  nvidia/label/cuda-12.3.2
cuda-compiler-12.3.2       |                0           2 KB  nvidia/label/cuda-12.3.2
cuda-cudart-12.3.101       |                0         197 KB  nvidia/label/cuda-12.3.2
cuda-cudart-dev-12.3.101   |                0         401 KB  nvidia/label/cuda-12.3.2
cuda-cudart-static-12.3.101|                0         1.1 MB  nvidia/label/cuda-12.3.2
cuda-cuobjdump-12.3.101    |                0         243 KB  nvidia/label/cuda-12.3.2
cuda-cupti-12.3.101        |                0        15.3 MB  nvidia/label/cuda-12.3.2
cuda-cupti-static-12.3.101 |                0        11.5 MB  nvidia/label/cuda-12.3.2
cuda-cuxxfilt-12.3.101     |                0         295 KB  nvidia/label/cuda-12.3.2
cuda-documentation-12.3.101|                0          89 KB  nvidia/label/cuda-12.3.2
cuda-driver-dev-12.3.101   |                0          18 KB  nvidia/label/cuda-12.3.2
cuda-gdb-12.3.101          |                0         5.3 MB  nvidia/label/cuda-12.3.2
cuda-libraries-12.3.2      |                0           2 KB  nvidia/label/cuda-12.3.2
cuda-libraries-dev-12.3.2  |                0           2 KB  nvidia/label/cuda-12.3.2
cuda-libraries-static-12.3.2|                0           2 KB  nvidia/label/cuda-12.3.2
cuda-nsight-12.3.101       |                0       113.7 MB  nvidia/label/cuda-12.3.2
cuda-nsight-compute-12.3.2 |                0           2 KB  nvidia/label/cuda-12.3.2
cuda-nvcc-12.3.107         |                0        58.2 MB  nvidia/label/cuda-12.3.2
cuda-nvdisasm-12.3.101     |                0        47.9 MB  nvidia/label/cuda-12.3.2
cuda-nvml-dev-12.3.101     |                0          92 KB  nvidia/label/cuda-12.3.2
cuda-nvprof-12.3.101       |                0         4.8 MB  nvidia/label/cuda-12.3.2
cuda-nvprune-12.3.101      |                0          65 KB  nvidia/label/cuda-12.3.2
cuda-nvrtc-12.3.107        |                0        21.3 MB  nvidia/label/cuda-12.3.2
cuda-nvrtc-dev-12.3.107    |                0          12 KB  nvidia/label/cuda-12.3.2
cuda-nvrtc-static-12.3.107 |                0        18.5 MB  nvidia/label/cuda-12.3.2
cuda-nvtx-12.3.101         |                0          58 KB  nvidia/label/cuda-12.3.2
cuda-nvvp-12.3.101         |                0       114.5 MB  nvidia/label/cuda-12.3.2
cuda-opencl-12.3.101       |                0          11 KB  nvidia/label/cuda-12.3.2
cuda-opencl-dev-12.3.101   |                0          59 KB  nvidia/label/cuda-12.3.2
cuda-profiler-api-12.3.101 |                0          19 KB  nvidia/label/cuda-12.3.2
cuda-sanitizer-api-12.3.101|                0        17.1 MB  nvidia/label/cuda-12.3.2
cuda-toolkit-12.3.2        |                0           2 KB  nvidia/label/cuda-12.3.2
cuda-tools-12.3.2          |                0           2 KB  nvidia/label/cuda-12.3.2
cuda-visual-tools-12.3.2   |                0           2 KB  nvidia/label/cuda-12.3.2
gds-tools-1.8.1.2          |                0        40.8 MB  nvidia/label/cuda-12.3.2
libcublas-12.3.4.1         |                0       351.3 MB  nvidia/label/cuda-12.3.2
libcublas-dev-12.3.4.1     |                0          75 KB  nvidia/label/cuda-12.3.2
libcublas-static-12.3.4.1  |                0       389.5 MB  nvidia/label/cuda-12.3.2
libcufft-11.0.12.1         |                0        83.1 MB  nvidia/label/cuda-12.3.2
libcufft-dev-11.0.12.1     |                0          14 KB  nvidia/label/cuda-12.3.2
libcufft-static-11.0.12.1  |                0       167.5 MB  nvidia/label/cuda-12.3.2
libcufile-1.8.1.2          |                0         1.0 MB  nvidia/label/cuda-12.3.2
libcufile-dev-1.8.1.2      |                0          15 KB  nvidia/label/cuda-12.3.2
libcufile-static-1.8.1.2   |                0         3.6 MB  nvidia/label/cuda-12.3.2
libcurand-10.3.4.107       |                0        51.8 MB  nvidia/label/cuda-12.3.2
libcurand-dev-10.3.4.107   |                0         449 KB  nvidia/label/cuda-12.3.2
libcurand-static-10.3.4.107|                0        51.9 MB  nvidia/label/cuda-12.3.2
libcusolver-11.5.4.101     |                0       111.3 MB  nvidia/label/cuda-12.3.2
libcusolver-dev-11.5.4.101 |                0          50 KB  nvidia/label/cuda-12.3.2
libcusolver-static-11.5.4.101|                0        72.8 MB  nvidia/label/cuda-12.3.2
libcusparse-12.2.0.103     |                0       170.4 MB  nvidia/label/cuda-12.3.2
libcusparse-dev-12.2.0.103 |                0       170.2 MB  nvidia/label/cuda-12.3.2
libcusparse-static-12.2.0.103|                0       177.2 MB  nvidia/label/cuda-12.3.2
libgcc-ng-13.2.0           |       h807b86a_5         752 KB  conda-forge
libgomp-13.2.0             |       h807b86a_5         410 KB  conda-forge
libnpp-12.2.3.2            |                0       144.7 MB  nvidia/label/cuda-12.3.2
libnpp-dev-12.2.3.2        |                0         538 KB  nvidia/label/cuda-12.3.2
libnpp-static-12.2.3.2     |                0       141.8 MB  nvidia/label/cuda-12.3.2
libnvjitlink-12.3.101      |                0        17.7 MB  nvidia/label/cuda-12.3.2
libnvjitlink-dev-12.3.101  |                0        14.7 MB  nvidia/label/cuda-12.3.2
libnvjpeg-12.3.0.81        |                0         3.0 MB  nvidia/label/cuda-12.3.2
libnvjpeg-dev-12.3.0.81    |                0          13 KB  nvidia/label/cuda-12.3.2
libnvjpeg-static-12.3.0.81 |                0         2.7 MB  nvidia/label/cuda-12.3.2
nsight-compute-2023.3.1.1  |                0       808.1 MB  nvidia/label/cuda-12.3.2
openssl-3.2.1              |       hd590300_1         2.7 MB  conda-forge
------------------------------------------------------------
                                       Total:        3.33 GB

The following NEW packages will be INSTALLED:

cuda-cccl nvidia/label/cuda-12.3.2/linux-64::cuda-cccl-12.3.101-0 cuda-command-line~ nvidia/label/cuda-12.3.2/linux-64::cuda-command-line-tools-12.3.2-0 cuda-compiler nvidia/label/cuda-12.3.2/linux-64::cuda-compiler-12.3.2-0 cuda-cudart nvidia/label/cuda-12.3.2/linux-64::cuda-cudart-12.3.101-0 cuda-cudart-dev nvidia/label/cuda-12.3.2/linux-64::cuda-cudart-dev-12.3.101-0 cuda-cudart-static nvidia/label/cuda-12.3.2/linux-64::cuda-cudart-static-12.3.101-0 cuda-cuobjdump nvidia/label/cuda-12.3.2/linux-64::cuda-cuobjdump-12.3.101-0 cuda-cupti nvidia/label/cuda-12.3.2/linux-64::cuda-cupti-12.3.101-0 cuda-cupti-static nvidia/label/cuda-12.3.2/linux-64::cuda-cupti-static-12.3.101-0 cuda-cuxxfilt nvidia/label/cuda-12.3.2/linux-64::cuda-cuxxfilt-12.3.101-0 cuda-documentation nvidia/label/cuda-12.3.2/linux-64::cuda-documentation-12.3.101-0 cuda-driver-dev nvidia/label/cuda-12.3.2/linux-64::cuda-driver-dev-12.3.101-0 cuda-gdb nvidia/label/cuda-12.3.2/linux-64::cuda-gdb-12.3.101-0 cuda-libraries nvidia/label/cuda-12.3.2/linux-64::cuda-libraries-12.3.2-0 cuda-libraries-dev nvidia/label/cuda-12.3.2/linux-64::cuda-libraries-dev-12.3.2-0 cuda-libraries-st~ nvidia/label/cuda-12.3.2/linux-64::cuda-libraries-static-12.3.2-0 cuda-nsight nvidia/label/cuda-12.3.2/linux-64::cuda-nsight-12.3.101-0 cuda-nsight-compu~ nvidia/label/cuda-12.3.2/linux-64::cuda-nsight-compute-12.3.2-0 cuda-nvcc nvidia/label/cuda-12.3.2/linux-64::cuda-nvcc-12.3.107-0 cuda-nvdisasm nvidia/label/cuda-12.3.2/linux-64::cuda-nvdisasm-12.3.101-0 cuda-nvml-dev nvidia/label/cuda-12.3.2/linux-64::cuda-nvml-dev-12.3.101-0 cuda-nvprof nvidia/label/cuda-12.3.2/linux-64::cuda-nvprof-12.3.101-0 cuda-nvprune nvidia/label/cuda-12.3.2/linux-64::cuda-nvprune-12.3.101-0 cuda-nvrtc nvidia/label/cuda-12.3.2/linux-64::cuda-nvrtc-12.3.107-0 cuda-nvrtc-dev nvidia/label/cuda-12.3.2/linux-64::cuda-nvrtc-dev-12.3.107-0 cuda-nvrtc-static nvidia/label/cuda-12.3.2/linux-64::cuda-nvrtc-static-12.3.107-0 cuda-nvtx nvidia/label/cuda-12.3.2/linux-64::cuda-nvtx-12.3.101-0 cuda-nvvp nvidia/label/cuda-12.3.2/linux-64::cuda-nvvp-12.3.101-0 cuda-opencl nvidia/label/cuda-12.3.2/linux-64::cuda-opencl-12.3.101-0 cuda-opencl-dev nvidia/label/cuda-12.3.2/linux-64::cuda-opencl-dev-12.3.101-0 cuda-profiler-api nvidia/label/cuda-12.3.2/linux-64::cuda-profiler-api-12.3.101-0 cuda-sanitizer-api nvidia/label/cuda-12.3.2/linux-64::cuda-sanitizer-api-12.3.101-0 cuda-toolkit nvidia/label/cuda-12.3.2/linux-64::cuda-toolkit-12.3.2-0 cuda-tools nvidia/label/cuda-12.3.2/linux-64::cuda-tools-12.3.2-0 cuda-visual-tools nvidia/label/cuda-12.3.2/linux-64::cuda-visual-tools-12.3.2-0 gds-tools nvidia/label/cuda-12.3.2/linux-64::gds-tools-1.8.1.2-0 libcublas nvidia/label/cuda-12.3.2/linux-64::libcublas-12.3.4.1-0 libcublas-dev nvidia/label/cuda-12.3.2/linux-64::libcublas-dev-12.3.4.1-0 libcublas-static nvidia/label/cuda-12.3.2/linux-64::libcublas-static-12.3.4.1-0 libcufft nvidia/label/cuda-12.3.2/linux-64::libcufft-11.0.12.1-0 libcufft-dev nvidia/label/cuda-12.3.2/linux-64::libcufft-dev-11.0.12.1-0 libcufft-static nvidia/label/cuda-12.3.2/linux-64::libcufft-static-11.0.12.1-0 libcufile nvidia/label/cuda-12.3.2/linux-64::libcufile-1.8.1.2-0 libcufile-dev nvidia/label/cuda-12.3.2/linux-64::libcufile-dev-1.8.1.2-0 libcufile-static nvidia/label/cuda-12.3.2/linux-64::libcufile-static-1.8.1.2-0 libcurand nvidia/label/cuda-12.3.2/linux-64::libcurand-10.3.4.107-0 libcurand-dev nvidia/label/cuda-12.3.2/linux-64::libcurand-dev-10.3.4.107-0 libcurand-static nvidia/label/cuda-12.3.2/linux-64::libcurand-static-10.3.4.107-0 libcusolver nvidia/label/cuda-12.3.2/linux-64::libcusolver-11.5.4.101-0 libcusolver-dev nvidia/label/cuda-12.3.2/linux-64::libcusolver-dev-11.5.4.101-0 libcusolver-static nvidia/label/cuda-12.3.2/linux-64::libcusolver-static-11.5.4.101-0 libcusparse nvidia/label/cuda-12.3.2/linux-64::libcusparse-12.2.0.103-0 libcusparse-dev nvidia/label/cuda-12.3.2/linux-64::libcusparse-dev-12.2.0.103-0 libcusparse-static nvidia/label/cuda-12.3.2/linux-64::libcusparse-static-12.2.0.103-0 libnpp nvidia/label/cuda-12.3.2/linux-64::libnpp-12.2.3.2-0 libnpp-dev nvidia/label/cuda-12.3.2/linux-64::libnpp-dev-12.2.3.2-0 libnpp-static nvidia/label/cuda-12.3.2/linux-64::libnpp-static-12.2.3.2-0 libnvjitlink nvidia/label/cuda-12.3.2/linux-64::libnvjitlink-12.3.101-0 libnvjitlink-dev nvidia/label/cuda-12.3.2/linux-64::libnvjitlink-dev-12.3.101-0 libnvjpeg nvidia/label/cuda-12.3.2/linux-64::libnvjpeg-12.3.0.81-0 libnvjpeg-dev nvidia/label/cuda-12.3.2/linux-64::libnvjpeg-dev-12.3.0.81-0 libnvjpeg-static nvidia/label/cuda-12.3.2/linux-64::libnvjpeg-static-12.3.0.81-0 nsight-compute nvidia/label/cuda-12.3.2/linux-64::nsight-compute-2023.3.1.1-0

The following packages will be UPDATED:

libgcc-ng pkgs/main::libgcc-ng-11.2.0-h1234567_1 --> conda-forge::libgcc-ng-13.2.0-h807b86a_5 libgomp pkgs/main::libgomp-11.2.0-h1234567_1 --> conda-forge::libgomp-13.2.0-h807b86a_5 openssl pkgs/main::openssl-3.0.13-h7f8727e_0 --> conda-forge::openssl-3.2.1-hd590300_1

The following packages will be SUPERSEDED by a higher-priority channel:

_libgcc_mutex pkgs/main::_libgcc_mutex-0.1-main --> conda-forge::_libgcc_mutex-0.1-conda_forge _openmp_mutex pkgs/main::_openmp_mutex-5.1-1_gnu --> conda-forge::_openmp_mutex-4.5-2_gnu certifi pkgs/main/linux-64::certifi-2024.2.2-~ --> conda-forge/noarch::certifi-2024.2.2-pyhd8ed1ab_0

Downloading and Extracting Packages:

Preparing transaction: done
Verifying transaction: done
Executing transaction: done
Installing ninja
Channels:

Package Plan

environment location: /home/user/AI/lollms/installer_files/lollms_env

added / updated specs:

The following packages will be downloaded: 

package                    |            build                              
---------------------------|-----------------                              
libstdcxx-ng-13.2.0        |       h7e041cc_5         3.7 MB  conda-forge  
ninja-1.11.1               |       h924138e_0         2.1 MB  conda-forge  
------------------------------------------------------------               
                                       Total:         5.8 MB

The following NEW packages will be INSTALLED:

ninja conda-forge/linux-64::ninja-1.11.1-h924138e_0

The following packages will be UPDATED:

libstdcxx-ng pkgs/main::libstdcxx-ng-11.2.0-h12345~ --> conda-forge::libstdcxx-ng-13.2.0-h7e041cc_5

Downloading and Extracting Packages:

Preparing transaction: done
Verifying transaction: done Executing transaction: done Installing cuda compiler Channels:

Package Plan

environment location: /home/user/AI/lollms/installer_files/lollms_env

added / updated specs:

Downloading and Extracting Packages:

Preparing transaction: done Verifying transaction: done Executing transaction: done Installing pytorch 2.1.1 Looking in indexes: https://download.pytorch.org/whl/cu121 Collecting torch Downloading https://download.pytorch.org/whl/cu121/torch-2.2.1%2Bcu121-cp311-cp311-linux_x86_64.whl (757.3 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 757.3/757.3 MB 11.5 MB/s eta 0:00:00 Collecting torchvision Downloading https://download.pytorch.org/whl/cu121/torchvision-0.17.1%2Bcu121-cp311-cp311-linux_x86_64.whl (7.0 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.0/7.0 MB 11.5 MB/s eta 0:00:00 Collecting torchaudio Downloading https://download.pytorch.org/whl/cu121/torchaudio-2.2.1%2Bcu121-cp311-cp311-linux_x86_64.whl (3.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.4/3.4 MB 11.7 MB/s eta 0:00:00 Requirement already satisfied: filelock in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch) (3.13.1) Requirement already satisfied: typing-extensions>=4.8.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch) (4.10.0) Collecting sympy (from torch) Downloading https://download.pytorch.org/whl/sympy-1.12-py3-none-any.whl (5.7 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.7/5.7 MB 11.5 MB/s eta 0:00:00 Collecting networkx (from torch) Downloading https://download.pytorch.org/whl/networkx-3.2.1-py3-none-any.whl (1.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 11.7 MB/s eta 0:00:00 Collecting jinja2 (from torch) Downloading https://download.pytorch.org/whl/Jinja2-3.1.2-py3-none-any.whl (133 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 133.1/133.1 kB 23.8 MB/s eta 0:00:00 Requirement already satisfied: fsspec in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch) (2024.3.1) Collecting nvidia-cuda-nvrtc-cu12==12.1.105 (from torch) Downloading https://download.pytorch.org/whl/cu121/nvidia_cuda_nvrtc_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (23.7 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23.7/23.7 MB 11.4 MB/s eta 0:00:00 Collecting nvidia-cuda-runtime-cu12==12.1.105 (from torch) Downloading https://download.pytorch.org/whl/cu121/nvidia_cuda_runtime_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (823 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 823.6/823.6 kB 11.5 MB/s eta 0:00:00 Collecting nvidia-cuda-cupti-cu12==12.1.105 (from torch) Downloading https://download.pytorch.org/whl/cu121/nvidia_cuda_cupti_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (14.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.1/14.1 MB 11.4 MB/s eta 0:00:00 Collecting nvidia-cudnn-cu12==8.9.2.26 (from torch) Downloading https://download.pytorch.org/whl/cu121/nvidia_cudnn_cu12-8.9.2.26-py3-none-manylinux1_x86_64.whl (731.7 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 731.7/731.7 MB 13.8 MB/s eta 0:00:00 Collecting nvidia-cublas-cu12==12.1.3.1 (from torch) Downloading https://download.pytorch.org/whl/cu121/nvidia_cublas_cu12-12.1.3.1-py3-none-manylinux1_x86_64.whl (410.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 410.6/410.6 MB 119.9 MB/s eta 0:00:00 Collecting nvidia-cufft-cu12==11.0.2.54 (from torch) Downloading https://download.pytorch.org/whl/cu121/nvidia_cufft_cu12-11.0.2.54-py3-none-manylinux1_x86_64.whl (121.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 121.6/121.6 MB 9.1 MB/s eta 0:00:00 Collecting nvidia-curand-cu12==10.3.2.106 (from torch) Downloading https://download.pytorch.org/whl/cu121/nvidia_curand_cu12-10.3.2.106-py3-none-manylinux1_x86_64.whl (56.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.5/56.5 MB 11.4 MB/s eta 0:00:00 Collecting nvidia-cusolver-cu12==11.4.5.107 (from torch) Downloading https://download.pytorch.org/whl/cu121/nvidia_cusolver_cu12-11.4.5.107-py3-none-manylinux1_x86_64.whl (124.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 124.2/124.2 MB 9.0 MB/s eta 0:00:00 Collecting nvidia-cusparse-cu12==12.1.0.106 (from torch) Downloading https://download.pytorch.org/whl/cu121/nvidia_cusparse_cu12-12.1.0.106-py3-none-manylinux1_x86_64.whl (196.0 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 196.0/196.0 MB 11.5 MB/s eta 0:00:00 Collecting nvidia-nccl-cu12==2.19.3 (from torch) Downloading https://download.pytorch.org/whl/cu121/nvidia_nccl_cu12-2.19.3-py3-none-manylinux1_x86_64.whl (166.0 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 166.0/166.0 MB 11.4 MB/s eta 0:00:00 Collecting nvidia-nvtx-cu12==12.1.105 (from torch) Downloading https://download.pytorch.org/whl/cu121/nvidia_nvtx_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (99 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 99.1/99.1 kB 12.1 MB/s eta 0:00:00 Collecting triton==2.2.0 (from torch) Downloading https://download.pytorch.org/whl/triton-2.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (167.9 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 167.9/167.9 MB 11.4 MB/s eta 0:00:00 Collecting nvidia-nvjitlink-cu12 (from nvidia-cusolver-cu12==11.4.5.107->torch) Downloading https://download.pytorch.org/whl/cu121/nvidia_nvjitlink_cu12-12.1.105-py3-none-manylinux1_x86_64.whl (19.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.8/19.8 MB 11.5 MB/s eta 0:00:00 Requirement already satisfied: numpy in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torchvision) (1.26.4) Requirement already satisfied: pillow!=8.3.,>=5.3.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torchvision) (10.2.0) Collecting MarkupSafe>=2.0 (from jinja2->torch) Downloading https://download.pytorch.org/whl/MarkupSafe-2.1.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (28 kB) Collecting mpmath>=0.19 (from sympy->torch) Downloading https://download.pytorch.org/whl/mpmath-1.3.0-py3-none-any.whl (536 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 536.2/536.2 kB 12.2 MB/s eta 0:00:00 Installing collected packages: mpmath, triton, sympy, nvidia-nvtx-cu12, nvidia-nvjitlink-cu12, nvidia-nccl-cu12, nvidia-curand-cu12, nvidia-cufft-cu12, nvidia-cuda-runtime-cu12, nvidia-cuda-nvrtc-cu12, nvidia-cuda-cupti-cu12, nvidia-cublas-cu12, networkx, MarkupSafe, nvidia-cusparse-cu12, nvidia-cudnn-cu12, jinja2, nvidia-cusolver-cu12, torch, torchvision, torchaudio Successfully installed MarkupSafe-2.1.3 jinja2-3.1.2 mpmath-1.3.0 networkx-3.2.1 nvidia-cublas-cu12-12.1.3.1 nvidia-cuda-cupti-cu12-12.1.105 nvidia-cuda-nvrtc-cu12-12.1.105 nvidia-cuda-runtime-cu12-12.1.105 nvidia-cudnn-cu12-8.9.2.26 nvidia-cufft-cu12-11.0.2.54 nvidia-curand-cu12-10.3.2.106 nvidia-cusolver-cu12-11.4.5.107 nvidia-cusparse-cu12-12.1.0.106 nvidia-nccl-cu12-2.19.3 nvidia-nvjitlink-cu12-12.1.105 nvidia-nvtx-cu12-12.1.105 sympy-1.12 torch-2.2.1+cu121 torchaudio-2.2.1+cu121 torchvision-0.17.1+cu121 triton-2.2.0 Ignoring auto-gptq: markers 'platform_system == "Windows" and python_version == "3.11"' don't match your environment Collecting auto-gptq==0.6.0+cu121 (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 14)) Downloading https://github.com/jllllll/AutoGPTQ/releases/download/v0.6.0/auto_gptq-0.6.0+cu121-cp311-cp311-linux_x86_64.whl (4.8 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.8/4.8 MB 9.2 MB/s eta 0:00:00 Ignoring exllamav2: markers 'platform_system == "Windows" and python_version == "3.11"' don't match your environment Ignoring exllamav2: markers 'platform_system == "Windows" and python_version == "3.10"' don't match your environment Collecting exllamav2==0.0.15+cu121 (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 21)) Downloading https://github.com/oobabooga/exllamav2/releases/download/v0.0.15/exllamav2-0.0.15+cu121-cp311-cp311-linux_x86_64.whl (72.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 72.2/72.2 MB 7.9 MB/s eta 0:00:00 Ignoring exllamav2: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version == "3.10"' don't match your environment Ignoring exllamav2: markers 'platform_system == "Linux" and platform_machine != "x86_64"' don't match your environment Ignoring flash-attn: markers 'platform_system == "Windows" and python_version == "3.11"' don't match your environment Ignoring flash-attn: markers 'platform_system == "Windows" and python_version == "3.10"' don't match your environment Collecting flash-attn==2.5.6+cu122torch2.2cxx11abiFALSE (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 28)) Downloading https://github.com/Dao-AILab/flash-attention/releases/download/v2.5.6/flash_attn-2.5.6+cu122torch2.2cxx11abiFALSE-cp311-cp311-linux_x86_64.whl (120.6 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 120.6/120.6 MB 7.6 MB/s eta 0:00:00 Ignoring flash-attn: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version == "3.10"' don't match your environment Ignoring auto-gptq: markers 'platform_system == "Windows" and python_version == "3.11"' don't match your environment Ignoring auto-gptq: markers 'platform_system == "Windows" and python_version == "3.10"' don't match your environment Ignoring auto-gptq: markers 'platform_system == "Linux" and platform_machine == "x86_64" and python_version == "3.10"' don't match your environment Collecting accelerate==0.27. (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) Using cached accelerate-0.27.2-py3-none-any.whl.metadata (18 kB) Collecting transformers==4.38. (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 2)) Using cached transformers-4.38.2-py3-none-any.whl.metadata (130 kB) Collecting numba==0.59. (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 3)) Using cached numba-0.59.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (2.7 kB) Requirement already satisfied: numpy==1.26. in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 4)) (1.26.4) Collecting optimum==1.17. (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) Using cached optimum-1.17.1-py3-none-any.whl.metadata (18 kB) Collecting peft==0.8. (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 6)) Using cached peft-0.8.2-py3-none-any.whl.metadata (25 kB) Requirement already satisfied: Pillow>=9.5.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 7)) (10.2.0) Requirement already satisfied: safetensors==0.4. in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 8)) (0.4.2) Collecting sentencepiece (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 9)) Using cached sentencepiece-0.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.7 kB) Requirement already satisfied: tqdm in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 10)) (4.66.2) Collecting aqlm==1.1.0 (from aqlm[cpu,gpu]==1.1.0->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 12)) Using cached aqlm-1.1.0-py3-none-any.whl.metadata (1.7 kB) Collecting bitsandbytes==0.43. (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 16)) Using cached bitsandbytes-0.43.0-py3-none-manylinux_2_24_x86_64.whl.metadata (1.8 kB) Collecting autoawq (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 31)) Downloading autoawq-0.2.4-cp311-cp311-manylinux2014_x86_64.whl.metadata (16 kB) Requirement already satisfied: packaging in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from -r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 36)) (24.0) Requirement already satisfied: psutil in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (5.9.8) Requirement already satisfied: pyyaml in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (6.0.1) Requirement already satisfied: torch>=1.10.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (2.2.1+cu121) Requirement already satisfied: huggingface-hub in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (0.21.4) Requirement already satisfied: filelock in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from transformers==4.38.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 2)) (3.13.1) Requirement already satisfied: regex!=2019.12.17 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from transformers==4.38.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 2)) (2023.12.25) Requirement already satisfied: requests in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from transformers==4.38.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 2)) (2.31.0) Requirement already satisfied: tokenizers<0.19,>=0.14 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from transformers==4.38.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 2)) (0.15.2) Collecting llvmlite<0.43,>=0.42.0dev0 (from numba==0.59.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 3)) Using cached llvmlite-0.42.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.8 kB) Collecting coloredlogs (from optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) Using cached coloredlogs-15.0.1-py2.py3-none-any.whl.metadata (12 kB) Requirement already satisfied: sympy in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) (1.12) Collecting datasets (from optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) Using cached datasets-2.18.0-py3-none-any.whl.metadata (20 kB) Requirement already satisfied: scipy>=1.11.3 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from aqlm[cpu,gpu]==1.1.0->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 12)) (1.12.0) Requirement already satisfied: triton>=2.1 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from aqlm[cpu,gpu]==1.1.0->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 12)) (2.2.0) Collecting ninja (from aqlm[cpu,gpu]==1.1.0->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 12)) Using cached ninja-1.11.1.1-py2.py3-none-manylinux1_x86_64.manylinux_2_5_x86_64.whl.metadata (5.3 kB) Collecting rouge (from auto-gptq==0.6.0+cu121->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 14)) Using cached rouge-1.0.1-py3-none-any.whl.metadata (4.1 kB) Collecting gekko (from auto-gptq==0.6.0+cu121->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 14)) Using cached gekko-1.0.7-py3-none-any.whl.metadata (3.0 kB) Requirement already satisfied: pandas in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from exllamav2==0.0.15+cu121->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 21)) (2.2.1) Collecting fastparquet (from exllamav2==0.0.15+cu121->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 21)) Using cached fastparquet-2024.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.1 kB) Requirement already satisfied: pygments in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from exllamav2==0.0.15+cu121->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 21)) (2.17.2) Collecting websockets (from exllamav2==0.0.15+cu121->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 21)) Using cached websockets-12.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.6 kB) Collecting einops (from flash-attn==2.5.6+cu122torch2.2cxx11abiFALSE->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 28)) Using cached einops-0.7.0-py3-none-any.whl.metadata (13 kB) Requirement already satisfied: typing-extensions>=4.8.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from autoawq->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 31)) (4.10.0) Requirement already satisfied: zstandard in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from autoawq->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 31)) (0.19.0) Collecting autoawq-kernels (from autoawq->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 31)) Using cached autoawq_kernels-0.0.6-cp311-cp311-manylinux2014_x86_64.whl.metadata (2.0 kB) Requirement already satisfied: fsspec>=2023.5.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from huggingface-hub->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (2024.3.1) Requirement already satisfied: networkx in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=1.10.0->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (3.2.1) Requirement already satisfied: jinja2 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=1.10.0->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (3.1.2) Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.1.105 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=1.10.0->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (12.1.105) Requirement already satisfied: nvidia-cuda-runtime-cu12==12.1.105 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=1.10.0->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (12.1.105) Requirement already satisfied: nvidia-cuda-cupti-cu12==12.1.105 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=1.10.0->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (12.1.105) Requirement already satisfied: nvidia-cudnn-cu12==8.9.2.26 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=1.10.0->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (8.9.2.26) Requirement already satisfied: nvidia-cublas-cu12==12.1.3.1 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=1.10.0->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (12.1.3.1) Requirement already satisfied: nvidia-cufft-cu12==11.0.2.54 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=1.10.0->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (11.0.2.54) Requirement already satisfied: nvidia-curand-cu12==10.3.2.106 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=1.10.0->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (10.3.2.106) Requirement already satisfied: nvidia-cusolver-cu12==11.4.5.107 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=1.10.0->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (11.4.5.107) Requirement already satisfied: nvidia-cusparse-cu12==12.1.0.106 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=1.10.0->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (12.1.0.106) Requirement already satisfied: nvidia-nccl-cu12==2.19.3 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=1.10.0->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (2.19.3) Requirement already satisfied: nvidia-nvtx-cu12==12.1.105 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=1.10.0->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (12.1.105) Requirement already satisfied: nvidia-nvjitlink-cu12 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from nvidia-cusolver-cu12==11.4.5.107->torch>=1.10.0->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (12.1.105) Collecting protobuf (from transformers[sentencepiece]>=4.26.0->optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) Using cached protobuf-5.26.0-cp37-abi3-manylinux2014_x86_64.whl.metadata (592 bytes) Collecting humanfriendly>=9.1 (from coloredlogs->optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) Using cached humanfriendly-10.0-py2.py3-none-any.whl.metadata (9.2 kB) Collecting pyarrow>=12.0.0 (from datasets->optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) Using cached pyarrow-15.0.2-cp311-cp311-manylinux_2_28_x86_64.whl.metadata (3.0 kB) Collecting pyarrow-hotfix (from datasets->optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) Using cached pyarrow_hotfix-0.6-py3-none-any.whl.metadata (3.6 kB) Collecting dill<0.3.9,>=0.3.0 (from datasets->optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) Using cached dill-0.3.8-py3-none-any.whl.metadata (10 kB) Collecting xxhash (from datasets->optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) Using cached xxhash-3.4.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (12 kB) Collecting multiprocess (from datasets->optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) Using cached multiprocess-0.70.16-py311-none-any.whl.metadata (7.2 kB) Collecting fsspec>=2023.5.0 (from huggingface-hub->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) Using cached fsspec-2024.2.0-py3-none-any.whl.metadata (6.8 kB) Requirement already satisfied: aiohttp in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from datasets->optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) (3.9.3) Requirement already satisfied: charset-normalizer<4,>=2 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from requests->transformers==4.38.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 2)) (2.0.4) Requirement already satisfied: idna<4,>=2.5 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from requests->transformers==4.38.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 2)) (3.4) Requirement already satisfied: urllib3<3,>=1.21.1 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from requests->transformers==4.38.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 2)) (2.1.0) Requirement already satisfied: certifi>=2017.4.17 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from requests->transformers==4.38.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 2)) (2024.2.2) Collecting cramjam>=2.3 (from fastparquet->exllamav2==0.0.15+cu121->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 21)) Using cached cramjam-2.8.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.2 kB) Requirement already satisfied: python-dateutil>=2.8.2 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from pandas->exllamav2==0.0.15+cu121->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 21)) (2.9.0.post0) Requirement already satisfied: pytz>=2020.1 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from pandas->exllamav2==0.0.15+cu121->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 21)) (2024.1) Requirement already satisfied: tzdata>=2022.7 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from pandas->exllamav2==0.0.15+cu121->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 21)) (2024.1) Requirement already satisfied: six in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from rouge->auto-gptq==0.6.0+cu121->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 14)) (1.16.0) Requirement already satisfied: mpmath>=0.19 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from sympy->optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) (1.3.0) Requirement already satisfied: aiosignal>=1.1.2 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from aiohttp->datasets->optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) (1.3.1) Requirement already satisfied: attrs>=17.3.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from aiohttp->datasets->optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) (23.2.0) Requirement already satisfied: frozenlist>=1.1.1 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from aiohttp->datasets->optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) (1.4.1) Requirement already satisfied: multidict<7.0,>=4.5 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from aiohttp->datasets->optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) (6.0.5) Requirement already satisfied: yarl<2.0,>=1.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from aiohttp->datasets->optimum==1.17.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 5)) (1.9.4) Requirement already satisfied: MarkupSafe>=2.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from jinja2->torch>=1.10.0->accelerate==0.27.->-r /home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/requirements.txt (line 1)) (2.1.3) Using cached accelerate-0.27.2-py3-none-any.whl (279 kB) Using cached transformers-4.38.2-py3-none-any.whl (8.5 MB) Using cached numba-0.59.1-cp311-cp311-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (3.7 MB) Using cached optimum-1.17.1-py3-none-any.whl (407 kB) Using cached peft-0.8.2-py3-none-any.whl (183 kB) Using cached aqlm-1.1.0-py3-none-any.whl (12 kB) Using cached bitsandbytes-0.43.0-py3-none-manylinux_2_24_x86_64.whl (102.2 MB) Using cached sentencepiece-0.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) Downloading autoawq-0.2.4-cp311-cp311-manylinux2014_x86_64.whl (80 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 80.8/80.8 kB 1.9 MB/s eta 0:00:00 Using cached llvmlite-0.42.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (43.8 MB) Using cached autoawq_kernels-0.0.6-cp311-cp311-manylinux2014_x86_64.whl (33.4 MB) Using cached coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB) Using cached datasets-2.18.0-py3-none-any.whl (510 kB) Using cached einops-0.7.0-py3-none-any.whl (44 kB) Using cached fastparquet-2024.2.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.8 MB) Using cached gekko-1.0.7-py3-none-any.whl (13.1 MB) Using cached ninja-1.11.1.1-py2.py3-none-manylinux1_x86_64.manylinux_2_5_x86_64.whl (307 kB) Using cached rouge-1.0.1-py3-none-any.whl (13 kB) Using cached websockets-12.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (130 kB) Using cached cramjam-2.8.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.0 MB) Using cached dill-0.3.8-py3-none-any.whl (116 kB) Using cached fsspec-2024.2.0-py3-none-any.whl (170 kB) Using cached humanfriendly-10.0-py2.py3-none-any.whl (86 kB) Using cached pyarrow-15.0.2-cp311-cp311-manylinux_2_28_x86_64.whl (38.3 MB) Using cached multiprocess-0.70.16-py311-none-any.whl (143 kB) Using cached protobuf-5.26.0-cp37-abi3-manylinux2014_x86_64.whl (302 kB) Using cached pyarrow_hotfix-0.6-py3-none-any.whl (7.9 kB) Using cached xxhash-3.4.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (194 kB) Installing collected packages: sentencepiece, ninja, xxhash, websockets, rouge, pyarrow-hotfix, pyarrow, protobuf, llvmlite, humanfriendly, gekko, fsspec, einops, dill, cramjam, numba, multiprocess, coloredlogs, fastparquet, transformers, flash-attn, exllamav2, datasets, bitsandbytes, autoawq-kernels, accelerate, peft, autoawq, aqlm, optimum, auto-gptq Attempting uninstall: fsspec Found existing installation: fsspec 2024.3.1 Uninstalling fsspec-2024.3.1: Successfully uninstalled fsspec-2024.3.1 Attempting uninstall: transformers Found existing installation: transformers 4.39.1 Uninstalling transformers-4.39.1: Successfully uninstalled transformers-4.39.1 Successfully installed accelerate-0.27.2 aqlm-1.1.0 auto-gptq-0.6.0+cu121 autoawq-0.2.4 autoawq-kernels-0.0.6 bitsandbytes-0.43.0 coloredlogs-15.0.1 cramjam-2.8.3 datasets-2.18.0 dill-0.3.8 einops-0.7.0 exllamav2-0.0.15+cu121 fastparquet-2024.2.0 flash-attn-2.5.6 fsspec-2024.2.0 gekko-1.0.7 humanfriendly-10.0 llvmlite-0.42.0 multiprocess-0.70.16 ninja-1.11.1.1 numba-0.59.1 optimum-1.17.1 peft-0.8.2 protobuf-5.26.0 pyarrow-15.0.2 pyarrow-hotfix-0.6 rouge-1.0.1 sentencepiece-0.2.0 transformers-4.38.2 websockets-12.0 xxhash-3.4.1 Processing /home/user/AI/lollms/personal_data/tmp/exllamav2 Preparing metadata (setup.py) ... done Requirement already satisfied: pandas in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from exllamav2==0.0.16) (2.2.1) Requirement already satisfied: ninja in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from exllamav2==0.0.16) (1.11.1.1) Requirement already satisfied: fastparquet in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from exllamav2==0.0.16) (2024.2.0) Requirement already satisfied: torch>=2.2.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from exllamav2==0.0.16) (2.2.1+cu121) Requirement already satisfied: safetensors>=0.3.2 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from exllamav2==0.0.16) (0.4.2) Requirement already satisfied: sentencepiece>=0.1.97 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from exllamav2==0.0.16) (0.2.0) Requirement already satisfied: pygments in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from exllamav2==0.0.16) (2.17.2) Requirement already satisfied: websockets in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from exllamav2==0.0.16) (12.0) Requirement already satisfied: regex in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from exllamav2==0.0.16) (2023.12.25) Requirement already satisfied: numpy in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from exllamav2==0.0.16) (1.26.4) Requirement already satisfied: filelock in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (3.13.1) Requirement already satisfied: typing-extensions>=4.8.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (4.10.0) Requirement already satisfied: sympy in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (1.12) Requirement already satisfied: networkx in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (3.2.1) Requirement already satisfied: jinja2 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (3.1.2) Requirement already satisfied: fsspec in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (2024.2.0) Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.1.105 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (12.1.105) Requirement already satisfied: nvidia-cuda-runtime-cu12==12.1.105 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (12.1.105) Requirement already satisfied: nvidia-cuda-cupti-cu12==12.1.105 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (12.1.105) Requirement already satisfied: nvidia-cudnn-cu12==8.9.2.26 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (8.9.2.26) Requirement already satisfied: nvidia-cublas-cu12==12.1.3.1 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (12.1.3.1) Requirement already satisfied: nvidia-cufft-cu12==11.0.2.54 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (11.0.2.54) Requirement already satisfied: nvidia-curand-cu12==10.3.2.106 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (10.3.2.106) Requirement already satisfied: nvidia-cusolver-cu12==11.4.5.107 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (11.4.5.107) Requirement already satisfied: nvidia-cusparse-cu12==12.1.0.106 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (12.1.0.106) Requirement already satisfied: nvidia-nccl-cu12==2.19.3 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (2.19.3) Requirement already satisfied: nvidia-nvtx-cu12==12.1.105 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (12.1.105) Requirement already satisfied: triton==2.2.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from torch>=2.2.0->exllamav2==0.0.16) (2.2.0) Requirement already satisfied: nvidia-nvjitlink-cu12 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from nvidia-cusolver-cu12==11.4.5.107->torch>=2.2.0->exllamav2==0.0.16) (12.1.105) Requirement already satisfied: cramjam>=2.3 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from fastparquet->exllamav2==0.0.16) (2.8.3) Requirement already satisfied: packaging in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from fastparquet->exllamav2==0.0.16) (24.0) Requirement already satisfied: python-dateutil>=2.8.2 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from pandas->exllamav2==0.0.16) (2.9.0.post0) Requirement already satisfied: pytz>=2020.1 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from pandas->exllamav2==0.0.16) (2024.1) Requirement already satisfied: tzdata>=2022.7 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from pandas->exllamav2==0.0.16) (2024.1) Requirement already satisfied: six>=1.5 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from python-dateutil>=2.8.2->pandas->exllamav2==0.0.16) (1.16.0) Requirement already satisfied: MarkupSafe>=2.0 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from jinja2->torch>=2.2.0->exllamav2==0.0.16) (2.1.3) Requirement already satisfied: mpmath>=0.19 in /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages (from sympy->torch>=2.2.0->exllamav2==0.0.16) (1.3.0) Building wheels for collected packages: exllamav2 Building wheel for exllamav2 (setup.py) ... - Message from syslogd@debian at Mar 24 10:00:19 ... kernel:[ 2827.965049] EXT4-fs (sda2): failed to convert unwritten extents to written extents -- potential data loss! (inode 40374237, error -30)

Message from syslogd@debian at Mar 24 10:00:19 ... kernel:[ 2827.965774] EXT4-fs (sda2): failed to convert unwritten extents to written extents -- potential data loss! (inode 31071303, error -30)

Message from syslogd@debian at Mar 24 10:00:19 ... kernel:[ 2827.965802] EXT4-fs (sda2): failed to convert unwritten extents to written extents -- potential data loss! (inode 31071273, error -30)

Message from syslogd@debian at Mar 24 10:00:19 ... kernel:[ 2827.965856] EXT4-fs (sda2): failed to convert unwritten extents to written extents -- potential data loss! (inode 31071267, error -30)

Message from syslogd@debian at Mar 24 10:00:19 ... kernel:[ 2827.965873] EXT4-fs (sda2): failed to convert unwritten extents to written extents -- potential data loss! (inode 31071296, error -30) error error: subprocess-exited-with-error

× python setup.py bdistwheel did not run successfully. │ exit code: 1 ╰─> [497 lines of output] Version: 0.0.16 warning: no previously-included files matching '*.pyc' found anywhere in distribution warning: no previously-included files matching 'dni*' found anywhere in distribution /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/command/build_py.py:207: _Warning: Package 'exllamav2.exllamav2ext' is absent from the packages configuration. !! 

          ********************************************************************************
          ############################
          # Package would be ignored #
          ############################
          Python recognizes 'exllamav2.exllamav2_ext' as an importable package[^1],
          but it is absent from setuptools' `packages` configuration.

          This leads to an ambiguous overall configuration. If you want to distribute this
          package, please make sure that 'exllamav2.exllamav2_ext' is explicitly added
          to the `packages` configuration field.

          Alternatively, you can also rely on setuptools' discovery methods
          (for example by using `find_namespace_packages(...)`/`find_namespace:`
          instead of `find_packages(...)`/`find:`).

          You can read more about "package discovery" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

          If you don't want 'exllamav2.exllamav2_ext' to be distributed and are
          already explicitly excluding 'exllamav2.exllamav2_ext' via
          `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
          you can try to use `exclude_package_data`, or `include-package-data=False` in
          combination with a more fine grained `package-data` configuration.

          You can read more about "package data files" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/datafiles.html

          [^1]: For Python, any directory (with suitable naming) can be imported,
                even if it does not contain any `.py` files.
                On the other hand, currently there is no concept of package data
                directory, all directories are treated like packages.
          ********************************************************************************

  !!
    check.warn(importable)
  /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/command/build_py.py:207: _Warning: Package 'exllamav2.exllamav2_ext.cpp' is absent from the `packages` configuration.
  !!

          ********************************************************************************
          ############################
          # Package would be ignored #
          ############################
          Python recognizes 'exllamav2.exllamav2_ext.cpp' as an importable package[^1],
          but it is absent from setuptools' `packages` configuration.

          This leads to an ambiguous overall configuration. If you want to distribute this
          package, please make sure that 'exllamav2.exllamav2_ext.cpp' is explicitly added
          to the `packages` configuration field.

          Alternatively, you can also rely on setuptools' discovery methods
          (for example by using `find_namespace_packages(...)`/`find_namespace:`
          instead of `find_packages(...)`/`find:`).

          You can read more about "package discovery" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

          If you don't want 'exllamav2.exllamav2_ext.cpp' to be distributed and are
          already explicitly excluding 'exllamav2.exllamav2_ext.cpp' via
          `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
          you can try to use `exclude_package_data`, or `include-package-data=False` in
          combination with a more fine grained `package-data` configuration.

          You can read more about "package data files" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/datafiles.html

          [^1]: For Python, any directory (with suitable naming) can be imported,
                even if it does not contain any `.py` files.
                On the other hand, currently there is no concept of package data
                directory, all directories are treated like packages.
          ********************************************************************************

  !!
    check.warn(importable)
  /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/command/build_py.py:207: _Warning: Package 'exllamav2.exllamav2_ext.cuda' is absent from the `packages` configuration.
  !!

          ********************************************************************************
          ############################
          # Package would be ignored #
          ############################
          Python recognizes 'exllamav2.exllamav2_ext.cuda' as an importable package[^1],
          but it is absent from setuptools' `packages` configuration.

          This leads to an ambiguous overall configuration. If you want to distribute this
          package, please make sure that 'exllamav2.exllamav2_ext.cuda' is explicitly added
          to the `packages` configuration field.

          Alternatively, you can also rely on setuptools' discovery methods
          (for example by using `find_namespace_packages(...)`/`find_namespace:`
          instead of `find_packages(...)`/`find:`).

          You can read more about "package discovery" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

          If you don't want 'exllamav2.exllamav2_ext.cuda' to be distributed and are
          already explicitly excluding 'exllamav2.exllamav2_ext.cuda' via
          `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
          you can try to use `exclude_package_data`, or `include-package-data=False` in
          combination with a more fine grained `package-data` configuration.

          You can read more about "package data files" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/datafiles.html

          [^1]: For Python, any directory (with suitable naming) can be imported,
                even if it does not contain any `.py` files.
                On the other hand, currently there is no concept of package data
                directory, all directories are treated like packages.
          ********************************************************************************

  !!
    check.warn(importable)
  /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/command/build_py.py:207: _Warning: Package 'exllamav2.exllamav2_ext.cuda.comp_units' is absent from the `packages` configuration.
  !!

          ********************************************************************************
          ############################
          # Package would be ignored #
          ############################
          Python recognizes 'exllamav2.exllamav2_ext.cuda.comp_units' as an importable package[^1],
          but it is absent from setuptools' `packages` configuration.

          This leads to an ambiguous overall configuration. If you want to distribute this
          package, please make sure that 'exllamav2.exllamav2_ext.cuda.comp_units' is explicitly added
          to the `packages` configuration field.

          Alternatively, you can also rely on setuptools' discovery methods
          (for example by using `find_namespace_packages(...)`/`find_namespace:`
          instead of `find_packages(...)`/`find:`).

          You can read more about "package discovery" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

          If you don't want 'exllamav2.exllamav2_ext.cuda.comp_units' to be distributed and are
          already explicitly excluding 'exllamav2.exllamav2_ext.cuda.comp_units' via
          `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
          you can try to use `exclude_package_data`, or `include-package-data=False` in
          combination with a more fine grained `package-data` configuration.

          You can read more about "package data files" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/datafiles.html

          [^1]: For Python, any directory (with suitable naming) can be imported,
                even if it does not contain any `.py` files.
                On the other hand, currently there is no concept of package data
                directory, all directories are treated like packages.
          ********************************************************************************

  !!
    check.warn(importable)
  /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/command/build_py.py:207: _Warning: Package 'exllamav2.exllamav2_ext.cuda.quant' is absent from the `packages` configuration.
  !!

          ********************************************************************************
          ############################
          # Package would be ignored #
          ############################
          Python recognizes 'exllamav2.exllamav2_ext.cuda.quant' as an importable package[^1],
          but it is absent from setuptools' `packages` configuration.

          This leads to an ambiguous overall configuration. If you want to distribute this
          package, please make sure that 'exllamav2.exllamav2_ext.cuda.quant' is explicitly added
          to the `packages` configuration field.

          Alternatively, you can also rely on setuptools' discovery methods
          (for example by using `find_namespace_packages(...)`/`find_namespace:`
          instead of `find_packages(...)`/`find:`).

          You can read more about "package discovery" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

          If you don't want 'exllamav2.exllamav2_ext.cuda.quant' to be distributed and are
          already explicitly excluding 'exllamav2.exllamav2_ext.cuda.quant' via
          `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
          you can try to use `exclude_package_data`, or `include-package-data=False` in
          combination with a more fine grained `package-data` configuration.

          You can read more about "package data files" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/datafiles.html

          [^1]: For Python, any directory (with suitable naming) can be imported,
                even if it does not contain any `.py` files.
                On the other hand, currently there is no concept of package data
                directory, all directories are treated like packages.
          ********************************************************************************

  !!
    check.warn(importable)
  /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/command/build_py.py:207: _Warning: Package 'exllamav2.generator.filters' is absent from the `packages` configuration.
  !!

          ********************************************************************************
          ############################
          # Package would be ignored #
          ############################
          Python recognizes 'exllamav2.generator.filters' as an importable package[^1],
          but it is absent from setuptools' `packages` configuration.

          This leads to an ambiguous overall configuration. If you want to distribute this
          package, please make sure that 'exllamav2.generator.filters' is explicitly added
          to the `packages` configuration field.

          Alternatively, you can also rely on setuptools' discovery methods
          (for example by using `find_namespace_packages(...)`/`find_namespace:`
          instead of `find_packages(...)`/`find:`).

          You can read more about "package discovery" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

          If you don't want 'exllamav2.generator.filters' to be distributed and are
          already explicitly excluding 'exllamav2.generator.filters' via
          `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
          you can try to use `exclude_package_data`, or `include-package-data=False` in
          combination with a more fine grained `package-data` configuration.

          You can read more about "package data files" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/datafiles.html

          [^1]: For Python, any directory (with suitable naming) can be imported,
                even if it does not contain any `.py` files.
                On the other hand, currently there is no concept of package data
                directory, all directories are treated like packages.
          ********************************************************************************

  !!
    check.warn(importable)
  /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/command/build_py.py:207: _Warning: Package 'exllamav2.server' is absent from the `packages` configuration.
  !!

          ********************************************************************************
          ############################
          # Package would be ignored #
          ############################
          Python recognizes 'exllamav2.server' as an importable package[^1],
          but it is absent from setuptools' `packages` configuration.

          This leads to an ambiguous overall configuration. If you want to distribute this
          package, please make sure that 'exllamav2.server' is explicitly added
          to the `packages` configuration field.

          Alternatively, you can also rely on setuptools' discovery methods
          (for example by using `find_namespace_packages(...)`/`find_namespace:`
          instead of `find_packages(...)`/`find:`).

          You can read more about "package discovery" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

          If you don't want 'exllamav2.server' to be distributed and are
          already explicitly excluding 'exllamav2.server' via
          `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
          you can try to use `exclude_package_data`, or `include-package-data=False` in
          combination with a more fine grained `package-data` configuration.

          You can read more about "package data files" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/datafiles.html

          [^1]: For Python, any directory (with suitable naming) can be imported,
                even if it does not contain any `.py` files.
                On the other hand, currently there is no concept of package data
                directory, all directories are treated like packages.
          ********************************************************************************

  !!
    check.warn(importable)
  /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/command/build_py.py:207: _Warning: Package 'exllamav2.tokenizer' is absent from the `packages` configuration.
  !!

          ********************************************************************************
          ############################
          # Package would be ignored #
          ############################
          Python recognizes 'exllamav2.tokenizer' as an importable package[^1],
          but it is absent from setuptools' `packages` configuration.

          This leads to an ambiguous overall configuration. If you want to distribute this
          package, please make sure that 'exllamav2.tokenizer' is explicitly added
          to the `packages` configuration field.

          Alternatively, you can also rely on setuptools' discovery methods
          (for example by using `find_namespace_packages(...)`/`find_namespace:`
          instead of `find_packages(...)`/`find:`).

          You can read more about "package discovery" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

          If you don't want 'exllamav2.tokenizer' to be distributed and are
          already explicitly excluding 'exllamav2.tokenizer' via
          `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
          you can try to use `exclude_package_data`, or `include-package-data=False` in
          combination with a more fine grained `package-data` configuration.

          You can read more about "package data files" on setuptools documentation page:

          - https://setuptools.pypa.io/en/latest/userguide/datafiles.html

          [^1]: For Python, any directory (with suitable naming) can be imported,
                even if it does not contain any `.py` files.
                On the other hand, currently there is no concept of package data
                directory, all directories are treated like packages.
          ********************************************************************************

  !!
    check.warn(importable)
  /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/utils/cpp_extension.py:415: UserWarning: The detected CUDA version (12.3) has a minor version mismatch with the version that was used to compile PyTorch (12.1). Most likely this shouldn't be a problem.
    warnings.warn(CUDA_MISMATCH_WARN.format(cuda_str_version, torch.version.cuda))
  /home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/utils/cpp_extension.py:425: UserWarning: There are no g++ version bounds defined for CUDA version 12.3
    warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
  Emitting ninja build file /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/build.ninja...
  Compiling objects...
  Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
  [1/38] c++ -MMD -MF /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cpp/sampling.o.d -pthread -B /home/user/AI/lollms/installer_files/lollms_env/compiler_compat -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /home/user/AI/lollms/installer_files/lollms_env/include -fPIC -O2 -isystem /home/user/AI/lollms/installer_files/lollms_env/include -fPIC -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cpp/sampling.cpp -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cpp/sampling.o -O3 -mavx2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
  /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cpp/sampling.cpp:427: warning: ignoring ‘#pragma unroll ’ [-Wunknown-pragmas]
    427 |     #pragma unroll(32)
        |
  /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cpp/sampling.cpp:430: warning: ignoring ‘#pragma unroll ’ [-Wunknown-pragmas]
    430 |     #pragma unroll(32)
        |
  [2/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/kernel_select.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/kernel_select.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/kernel_select.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  [3/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/cache.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/cache.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/cache.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  [4/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_gptq_1.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/unit_gptq_1.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_gptq_1.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  [5/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_gptq_2.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/unit_gptq_2.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_gptq_2.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  [6/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_gptq_3.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/unit_gptq_3.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_gptq_3.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  [7/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/h_add.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/h_add.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/h_add.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  ninja: error: remove(/home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/layer_norm.o.d): Read-only file system
  [8/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/layer_norm.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/layer_norm.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/layer_norm.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  FAILED: /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/layer_norm.o
  /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/layer_norm.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/layer_norm.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/layer_norm.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  Assembler messages:
  Fatal error: can't create /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/layer_norm.o: Read-only file system
  ninja: error: remove(/home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/h_gemm.o.d): Read-only file system
  [9/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/h_gemm.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/h_gemm.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/h_gemm.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  FAILED: /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/h_gemm.o
  /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/h_gemm.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/h_gemm.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/h_gemm.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  deleting depfile: Read-only file system
  ninja: error: remove(/home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/lora.o.d): Read-only file system
  [10/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/lora.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/lora.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/lora.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  FAILED: /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/lora.o
  /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/lora.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/lora.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/lora.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  deleting depfile: Read-only file system
  ninja: error: remove(/home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/q_attn.o.d): Read-only file system
  [11/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/q_attn.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/q_attn.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/q_attn.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  FAILED: /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/q_attn.o
  /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/q_attn.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/q_attn.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/q_attn.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  deleting depfile: Read-only file system
  ninja: error: remove(/home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/q_gemm.o.d): Read-only file system
  [12/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/q_gemm.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/q_gemm.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/q_gemm.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  FAILED: /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/q_gemm.o
  /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/q_gemm.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/q_gemm.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/q_gemm.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  Assembler messages:
  Fatal error: can't create /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/q_gemm.o: Read-only file system
  ninja: error: remove(/home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3a.o.d): Read-only file system
  [13/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3a.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3a.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3a.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  FAILED: /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3a.o
  /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3a.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3a.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3a.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  Assembler messages:
  Fatal error: can't create /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3a.o: Read-only file system
  ninja: error: remove(/home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/pack_tensor.o.d): Read-only file system
  [14/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/pack_tensor.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/pack_tensor.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/pack_tensor.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  FAILED: /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/pack_tensor.o
  /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/pack_tensor.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/pack_tensor.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/pack_tensor.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  deleting depfile: Read-only file system
  ninja: error: remove(/home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2a.o.d): Read-only file system
  [15/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2a.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2a.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2a.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  FAILED: /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2a.o
  /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2a.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2a.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2a.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  Assembler messages:
  Fatal error: can't create /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2a.o: Read-only file system
  ninja: error: remove(/home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1a.o.d): Read-only file system
  [16/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1a.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1a.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1a.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  FAILED: /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1a.o
  /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1a.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1a.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1a.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  Assembler messages:
  Fatal error: can't create /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1a.o: Read-only file system
  [17/38] c++ -MMD -MF /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cpp/quantize_func.o.d -pthread -B /home/user/AI/lollms/installer_files/lollms_env/compiler_compat -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /home/user/AI/lollms/installer_files/lollms_env/include -fPIC -O2 -isystem /home/user/AI/lollms/installer_files/lollms_env/include -fPIC -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cpp/quantize_func.cpp -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cpp/quantize_func.o -O3 -mavx2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
  FAILED: /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cpp/quantize_func.o
  c++ -MMD -MF /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cpp/quantize_func.o.d -pthread -B /home/user/AI/lollms/installer_files/lollms_env/compiler_compat -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /home/user/AI/lollms/installer_files/lollms_env/include -fPIC -O2 -isystem /home/user/AI/lollms/installer_files/lollms_env/include -fPIC -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cpp/quantize_func.cpp -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cpp/quantize_func.o -O3 -mavx2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
  /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cpp/quantize_func.cpp:82:1: fatal error: opening dependency file /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cpp/quantize_func.o.d: Read-only file system
     82 | }
        | ^
  compilation terminated.
  [18/38] c++ -MMD -MF /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cpp/safetensors.o.d -pthread -B /home/user/AI/lollms/installer_files/lollms_env/compiler_compat -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /home/user/AI/lollms/installer_files/lollms_env/include -fPIC -O2 -isystem /home/user/AI/lollms/installer_files/lollms_env/include -fPIC -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cpp/safetensors.cpp -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cpp/safetensors.o -O3 -mavx2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
  FAILED: /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cpp/safetensors.o
  c++ -MMD -MF /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cpp/safetensors.o.d -pthread -B /home/user/AI/lollms/installer_files/lollms_env/compiler_compat -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /home/user/AI/lollms/installer_files/lollms_env/include -fPIC -O2 -isystem /home/user/AI/lollms/installer_files/lollms_env/include -fPIC -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cpp/safetensors.cpp -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cpp/safetensors.o -O3 -mavx2 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
  /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cpp/safetensors.cpp:375:1: fatal error: opening dependency file /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cpp/safetensors.o.d: Read-only file system
    375 | }
        | ^
  compilation terminated.
  ninja: error: remove(/home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1b.o.d): Read-only file system
  [19/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1b.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1b.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1b.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  FAILED: /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1b.o
  /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1b.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1b.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_1b.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  ptxas fatal   : Output file '/tmp/tmpxft_00000846_00000000-8_unit_exl2_1b.sm_60.cubin' could not be opened
  ninja: error: remove(/home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2b.o.d): Read-only file system
  [20/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2b.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2b.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2b.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  FAILED: /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2b.o
  /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2b.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2b.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_2b.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  ptxas fatal   : Output file '/tmp/tmpxft_0000084a_00000000-8_unit_exl2_2b.sm_60.cubin' could not be opened
  ninja: error: remove(/home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3b.o.d): Read-only file system
  [21/38] /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3b.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3b.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3b.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  FAILED: /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3b.o
  /home/user/AI/lollms/installer_files/lollms_env/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3b.o.d -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/TH -I/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/include/THC -I/home/user/AI/lollms/installer_files/lollms_env/include -I/home/user/AI/lollms/installer_files/lollms_env/include/python3.11 -c -c /home/user/AI/lollms/personal_data/tmp/exllamav2/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3b.cu -o /home/user/AI/lollms/personal_data/tmp/exllamav2/build/temp.linux-x86_64-cpython-311/exllamav2/exllamav2_ext/cuda/comp_units/unit_exl2_3b.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=exllamav2_ext -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=compute_60 -gencode=arch=compute_60,code=sm_60 -std=c++17
  ptxas fatal   : Output file '/tmp/tmpxft_0000084f_00000000-8_unit_exl2_3b.sm_60.cubin' could not be opened
  ninja: build stopped: subcommand failed.
  Traceback (most recent call last):
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 2096, in _run_ninja_build
      subprocess.run(
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/subprocess.py", line 571, in run
      raise CalledProcessError(retcode, process.args,
  subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

  The above exception was the direct cause of the following exception:

  Traceback (most recent call last):
    File "<string>", line 2, in <module>
    File "<pip-setuptools-caller>", line 34, in <module>
    File "/home/user/AI/lollms/personal_data/tmp/exllamav2/setup.py", line 87, in <module>
      setup(
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/__init__.py", line 104, in setup
      return distutils.core.setup(**attrs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 185, in setup
      return run_commands(dist)
             ^^^^^^^^^^^^^^^^^^
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
      dist.run_commands()
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
      self.run_command(cmd)
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/dist.py", line 967, in run_command
      super().run_command(command)
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
      cmd_obj.run()
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/wheel/bdist_wheel.py", line 364, in run
      self.run_command("build")
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
      self.distribution.run_command(command)
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/dist.py", line 967, in run_command
      super().run_command(command)
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
      cmd_obj.run()
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/_distutils/command/build.py", line 131, in run
      self.run_command(cmd_name)
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
      self.distribution.run_command(command)
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/dist.py", line 967, in run_command
      super().run_command(command)
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
      cmd_obj.run()
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 91, in run
      _build_ext.run(self)
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 345, in run
      self.build_extensions()
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 871, in build_extensions
      build_ext.build_extensions(self)
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 467, in build_extensions
      self._build_extensions_serial()
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 493, in _build_extensions_serial
      self.build_extension(ext)
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 252, in build_extension
      _build_ext.build_extension(self, ext)
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 548, in build_extension
      objects = self.compiler.compile(
                ^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 684, in unix_wrap_ninja_compile
      _write_ninja_file_and_compile_objects(
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1774, in _write_ninja_file_and_compile_objects
      _run_ninja_build(
    File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 2112, in _run_ninja_build
      raise RuntimeError(message) from e
  RuntimeError: Error compiling objects for extension
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for exllamav2 Running setup.py clean for exllamav2 error: subprocess-exited-with-error

× python setup.py clean did not run successfully. │ exit code: 1 ╰─> [35 lines of output] Traceback (most recent call last): File "", line 2, in File "", line 34, in File "/home/user/AI/lollms/personal_data/tmp/exllamav2/setup.py", line 2, in from torch.utils import cpp_extension File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/init.py", line 1537, in import torch.utils.data File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/utils/data/init.py", line 21, in from torch.utils.data.datapipes.datapipe import ( File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/utils/data/datapipes/init.py", line 1, in from . import iter File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/utils/data/datapipes/iter/init.py", line 1, in from torch.utils.data.datapipes.iter.utils import ( File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/utils/data/datapipes/iter/utils.py", line 3, in from torch.utils.data.datapipes.datapipe import IterDataPipe File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/utils/data/datapipes/datapipe.py", line 7, in from torch.utils.data.datapipes.utils.common import ( File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/utils/data/datapipes/utils/common.py", line 13, in from torch.utils.data._utils.serialization import DILL_AVAILABLE File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/torch/utils/data/_utils/serialization.py", line 2, in import dill File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/dill/init.py", line 33, in from .session import ( File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/site-packages/dill/session.py", line 36, in TEMPDIR = pathlib.PurePath(tempfile.gettempdir()) ^^^^^^^^^^^^^^^^^^^^^ File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/tempfile.py", line 316, in gettempdir return _os.fsdecode(_gettempdir()) ^^^^^^^^^^^^^ File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/tempfile.py", line 309, in _gettempdir tempdir = _get_default_tempdir() ^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/AI/lollms/installer_files/lollms_env/lib/python3.11/tempfile.py", line 224, in _get_default_tempdir raise FileNotFoundError(_errno.ENOENT, FileNotFoundError: [Errno 2] No usable temporary directory found in ['/home/user/AI/lollms/installer_files/temp', '/home/user/AI/lollms/installer_files/temp', '/tmp', '/var/tmp', '/usr/tmp', '/home/user/AI/lollms/personal_data/tmp/exllamav2'] [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed cleaning build dir for exllamav2 WARNING: Failed to remove contents in a temporary directory '/tmp/pip-wheel-la5r2o1s'. You can safely remove it manually. Failed to build exllamav2 ERROR: Could not build wheels for exllamav2, which is required to install pyproject.toml-based projects WARNING: Failed to remove contents in a temporary directory '/tmp/pip-build-tracker-v6u7ma3t'. You can safely remove it manually. WARNING: Failed to remove contents in a temporary directory '/tmp/pip-unpack-c47x7yn7'. You can safely remove it manually. WARNING: Failed to remove contents in a temporary directory '/tmp/pip-pip-egg-info-3baihfdu'. You can safely remove it manually. WARNING: Failed to remove contents in a temporary directory '/tmp/pip-ephem-wheel-cache-0k06u604'. You can safely remove it manually. WARNING: Failed to remove contents in a temporary directory '/tmp/pip-install-p14a3fb6'. You can safely remove it manually. Subprocess failed with returncode 1 Do you want me to install flash attention? Flash attention is required by some models but can take up to 1h to be built on your system! You can deactivate its use in the configuration. (yes/no): no Traceback (most recent call last): File "/home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/init.py", line 893, in exl = ExLLamav2(config, lollms_paths,lollmsCom=lollms_app) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/init.py", line 94, in init super().init( File "/home/user/AI/lollms/lollms-webui/lollms_core/lollms/binding.py", line 96, in init self.install() File "/home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/init.py", line 374, in install self.binding_config.save() File "/home/user/AI/lollms/lollms-webui/lollms_core/lollms/config.py", line 588, in save self.config.save_config(file_path=file_path) File "/home/user/AI/lollms/lollms-webui/lollms_core/lollms/config.py", line 402, in save_config with open(file_path, "w") as f: ^^^^^^^^^^^^^^^^^^^^ OSError: [Errno 30] Read-only file system: '/home/user/AI/lollms/personal_data/configs/bindings/bs_exllamav2/config.yaml' Traceback (most recent call last): File "/home/user/AI/lollms/lollms-webui/zoos/bindings_zoo/bs_exllamav2/init.py", line 135, in del import torch ImportError: sys.meta_path is None, Python is likely shutting down

i have added bold/itallic to where i think the errors started

any help is appreciated