search

llSourcell / Doctor-Dignity

Doctor Dignity is an LLM that can pass the US Medical Licensing Exam. It works offline, it's cross-platform, & your health data stays private.
Apache License 2.0
3.85k stars 404 forks source link

Usage #1

Open geraudloup opened 1 year ago

geraudloup commented 1 year ago

You say it is possible to use it with MLC Chat, but I think it needs a config file that is missing ! mlc-chat-config.json ... Here is the screenshot : Screenshot_20230813-010309_MLCChat.jpg

billylo1 commented 1 year ago

Similar error on iOS as well.

bschleter commented 1 year ago

Same error on ios. It's a 4.4GB or so file.

Configure in the iOS app, but early on the llama 7B didn't work for MLC either.

I've seen in their official MLC LLAMA 2, https://huggingface.co/mlc-ai/mlc-chat-Llama-2-7b-chat-hf-q3f16_1

they sharded the model into 100 different shards. I would encourage doing that, maybe 50 as it may have more success.

Do that, and check the mobile config, it's likely not configed for the app yet.

bradydjohnson commented 1 year ago

IMG_2978 Same problem here.

fpena06 commented 1 year ago

Same problem. I also tried loading on text-generation-webui and gave same error.

jmanhype commented 1 year ago

Please fix asap

zizhegao commented 1 year ago

no config file