search

oobabooga / one-click-installers

Simplified installers for oobabooga/text-generation-webui.
GNU Affero General Public License v3.0
550 stars 186 forks source link

Fix dependencies downgrading from gptq install #61

Closed jllllll closed 1 year ago

jllllll commented 1 year ago

Dependency version bumps were getting reverted on gptq install.

Should be fine to not install gptq's requirements.txt as the same dependencies are already included in the main repo.

It's worth mentioning that the backup wheel for Windows gptq is now being compiled through GitHub Actions. This should provide security and transparency along with a more consistent build environment. The current wheel's build can be viewed here: https://github.com/jllllll/GPTQ-for-LLaMa-Wheels/actions/runs/5013578202/jobs/8986826739

I am now also compiling wheels for Linux x86_64. I'm unsure how to incorporate that into the script, or if that is even necessary.

oobabooga commented 1 year ago

Thank you, indeed installing the gptq requirements is not necessary.

It is very nice that you got github actions to compile the wheels. I was interested in doing that myself for https://github.com/oobabooga/GPTQ-for-LLaMa, but now I don't have to go through the trouble.

I'll do some testing later and will try to incorporate the linux wheels in the one click installer. This is necessary because linux systems usually don't have nvcc available.