search

nomic-ai / gpt4all

GPT4All: Chat with Local LLMs on Any Device
https://gpt4all.io
MIT License
67.38k stars 7.42k forks source link

dolphin-2.9.2-qwen2-72b-gguf， Cannot run, cannot use, error #2418

Open v66886v opened 1 month ago

v66886v commented 1 month ago

dolphin-2.9.2-qwen2-72b-gguf， Cannot run, cannot use, error

微信图片_20240607184118

chrisbarrera commented 1 month ago

From the sidelines, and for what its worth, the mentioned model was uploaded 8-9 days before the real Qwen2 72b release. With a blank model card. It may certainly have come from Dolphin but its provenance and quality is dubious. I just downloaded mradermacher/Qwen2-72B-Instruct-GGUF (https://huggingface.co/mradermacher/Qwen2-72B-Instruct-GGUF) which works fine. Dolphin appears to be uploading their own fine-tunes based on Qwen2 but haven't uploaded yet a gguf of 72b other than the aforementioned spurious one.