NixOS compatibility (via nix-shell)

Woolverine94 / biniou

a self-hosted webui for 30+ generative ai

GNU General Public License v3.0

439 stars 42 forks source link

NixOS compatibility (via nix-shell) #36

Open deftdawg opened 2 weeks ago

deftdawg commented 2 weeks ago

create shell.nix build environment for NixOS
Update Torch and Numpy versions
Skip cert generation if private key already exists
Add instructions to build and run in a Nix shell (NixOS)

It runs as it is...

To do:

update RoCM upgrade script (don't have a Cuda card to test NVIDIA)
fix TC Malloc for NixOS compatibility in webui.sh

Woolverine94 commented 2 weeks ago

Hello @deftdawg,

Thanks for your PR and your interest in the project.

I will need some time to review your code and make some tests.

I can already say you that the use of torch==2.2.0 will break audiocraft-based modules, and it is not an option. If it's a pre-requisite for use on NixOS, then it's a no go.

Same for the update of numpy to 1.26.4 : bad idea ...

Thanks again

deftdawg commented 2 weeks ago

No worries, I bumped numpy to 1.26.4 because my install was defaulting to Python 3.12, eventually I had to downgrade to 3.11, I'll see about reverting that when I have another go to see if I can get RoCM running.

Leave it open til I get a chance to work on it some more (or cherry pick parts of it). All good 😀

Woolverine94 commented 2 weeks ago

Python 3.12 won't work with torch==2.1.0 :( ... (at least not on systems i've deployed biniou).

Leave it open til I get a chance to work on it some more (or cherry pick parts of it). All good 😀

Of course ! I'll be really happy to merge your PR if we can find a way to make it work efficiently !

And you can take your time, as I've very few time to work on biniou these days ...

Woolverine94 commented 2 weeks ago

@deftdawg,

Thanks for your modifications.

I'll watch it asap, but be patient : there's a lot of things I want to test before merging your pull request.

deftdawg commented 1 week ago

No worries, I'm still poking away at it gonna try to get RoCM going and maybe intel arc since I have those 2 GPUs on hand