Nix offers a reproducible build environment. I have compiled koboldcpp on Ubuntu and Arch before. It was always a chore especially when I had CUDA version dependencies conflicting with other projects. So, I wonder if you can add flake.nix to streamline the build process?
This is the flake I am using to install all dependencies. I have successfully compiled the project on both Ubuntu, Nixos and Arch. Nix claims it should also work on Mac and WSL2 but I haven't tested.
Nix offers a reproducible build environment. I have compiled koboldcpp on Ubuntu and Arch before. It was always a chore especially when I had CUDA version dependencies conflicting with other projects. So, I wonder if you can add flake.nix to streamline the build process?
This is the flake I am using to install all dependencies. I have successfully compiled the project on both Ubuntu, Nixos and Arch. Nix claims it should also work on Mac and WSL2 but I haven't tested.