search

llSourcell / Doctor-Dignity

Doctor Dignity is an LLM that can pass the US Medical Licensing Exam. It works offline, it's cross-platform, & your health data stays private.
Apache License 2.0
3.83k stars 406 forks source link

Usage #1

Open geraudloup opened 11 months ago

geraudloup commented 11 months ago

You say it is possible to use it with MLC Chat, but I think it needs a config file that is missing ! mlc-chat-config.json ... Here is the screenshot : Screenshot_20230813-010309_MLCChat.jpg

billylo1 commented 11 months ago

Similar error on iOS as well.

bschleter commented 11 months ago

Same error on ios. It's a 4.4GB or so file.

Configure in the iOS app, but early on the llama 7B didn't work for MLC either.

I've seen in their official MLC LLAMA 2, https://huggingface.co/mlc-ai/mlc-chat-Llama-2-7b-chat-hf-q3f16_1

they sharded the model into 100 different shards. I would encourage doing that, maybe 50 as it may have more success.

Do that, and check the mobile config, it's likely not configed for the app yet.

bradydjohnson commented 11 months ago

IMG_2978 Same problem here.

fpena06 commented 11 months ago

Same problem. I also tried loading on text-generation-webui and gave same error.

jmanhype commented 11 months ago

Please fix asap

zizhegao commented 11 months ago

no config file