StableLM-Zephyr-3b AND Magicoder 6.7B both not working

nomic-ai / gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

https://nomic.ai/gpt4all

MIT License

69.02k stars 7.57k forks source link

StableLM-Zephyr-3b AND Magicoder 6.7B both not working #1732

Open PedzacyKapec opened 9 months ago

PedzacyKapec commented 9 months ago

System Info

gpt4all latest version, win10

Information

[ ] The official example notebooks/scripts
[ ] My own modified scripts

Reproduction

load up
error message

Expected behavior

to work

cebtenzzre commented 9 months ago

StableLM-Zephyr-3b is not expected to work until the next release, which will improve compatibility with more recent third-party conversions of models that use a GPT2 tokenizer. Without testing it for myself, I'm not sure why Magicoder-S-DS-6.7B wouldn't work.

brankoradovanovic-mcom commented 8 months ago

Actually I don't think any of the 3b models work - at least I haven't been able to find one that does. One example is phi-2, sadly. It would be really nice if the next release supported these too.

JeroenAdam commented 8 months ago

Phi2 not working in the new release v2.6.1 today, the release notes state that llama.cpp dating back to November 23rd was integrated while Phi2-support came on Dec 18.

cebtenzzre commented 8 months ago

Phi2 not working in the new release v2.6.1 today, the release notes state that llama.cpp dating back to November 23rd was integrated while Phi2-support came on Dec 18.

phi-2 support is added in #1819