search

aleeusgr / nix-things

a toolbox
1 stars 0 forks source link

integrate gpt4all #73

Closed aleeusgr closed 6 months ago

aleeusgr commented 6 months ago

https://github.com/polygon/gpt4all-nix

aleeusgr commented 6 months ago

https://github.com/polygon/gpt4all-nix/issues/5

However downloading the model from the_bloke here and putting it in /home/username/.local/share/nomic.ai/GPT4All/ worked just fine as a workaround.

aleeusgr commented 6 months ago

A smaller model:

https://huggingface.co/TheBloke/smol-7B-GGUF/blob/main/smol-7b.Q2_K.gguf

aleeusgr commented 6 months ago

download the model and save to .local/share/nomicAI/chatGPT/

aleeusgr commented 6 months ago

https://github.com/NixOS/nixpkgs/pull/249553

aleeusgr commented 6 months ago

works