Open PedzacyKapec opened 9 months ago
StableLM-Zephyr-3b is not expected to work until the next release, which will improve compatibility with more recent third-party conversions of models that use a GPT2 tokenizer. Without testing it for myself, I'm not sure why Magicoder-S-DS-6.7B wouldn't work.
Actually I don't think any of the 3b models work - at least I haven't been able to find one that does. One example is phi-2, sadly. It would be really nice if the next release supported these too.
Phi2 not working in the new release v2.6.1 today, the release notes state that llama.cpp dating back to November 23rd was integrated while Phi2-support came on Dec 18.
Phi2 not working in the new release v2.6.1 today, the release notes state that llama.cpp dating back to November 23rd was integrated while Phi2-support came on Dec 18.
phi-2 support is added in #1819
System Info
gpt4all latest version, win10
Information
Reproduction
Expected behavior
to work