search

Maknee / minigpt4.cpp

Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)
MIT License
550 stars 26 forks source link

two questions #17

Open Amin456789 opened 9 months ago

Amin456789 commented 9 months ago

Hello!

thank you for this.

is there any chance getting a gui without needing to install python like koboldcpp in the future for its portability?

also, can we use this with other models like wizardlm too?

kind regards

Maknee commented 9 months ago

Maybe in the future. Unfortunately, GUI is using python right now, but the CLI version works without any dependencies at least for now.

wizardlm is a different model than vicuna. minigpt4 weights was trained with vicuna, so it will not work wizardlm. If someone has trained minigpt4 with wizardlm and has provided those weights, then I can add those.

Amin456789 commented 9 months ago

thank you for replay, can u please show us how to use cli version in the description by adding the tutorial? is it like stable diffusion cpp to use with cmd? what are the commands in cmd?

kind regards