search

oobabooga / one-click-installers

Simplified installers for oobabooga/text-generation-webui.
GNU Affero General Public License v3.0
550 stars 186 forks source link

Improve environment isolation #68

Closed jllllll closed 1 year ago

jllllll commented 1 year ago

This sets the CUDA_HOME and CUDA_PATH environment variables to point to the Cuda Toolkit installed into the environment. This should prevent issues with bitsandbytes not finding Cuda.

In addition to that, it also sets PYTHONNOUSERSITE=1 and unsets PYTHONPATH and PYTHONHOME.

This may need more testing to ensure that removing those variables does not cause issues. My understanding is that they aren't supposed to be set beforehand in the first place. These variables have been causing issues on systems that have them set: https://github.com/oobabooga/text-generation-webui/issues/1351#issuecomment-1560313923

Please ensure that I've used the right syntax for the bash scripts.

oobabooga commented 1 year ago

I have tested the linux installer and it worked flawlessly. The syntax is correct. Thanks for looking into this, that's another issue that I would never have solved on my own.