Would it be possible to support the loading of Gemma models?

gokayfem / ComfyUI_VLM_nodes

Custom ComfyUI nodes for Vision Language Models, Large Language Models, Image to Music, Text to Music, Consistent and Random Creative Prompt Generation

Apache License 2.0

400 stars 35 forks source link

Would it be possible to support the loading of Gemma models? #20

Closed rui40000 closed 8 months ago

rui40000 commented 8 months ago

https://huggingface.co/lmstudio-ai/gemma-2b-it-GGUF/tree/main I noticed that the Gemma models are also in Gguf format, would it be possible to support the loading of Gemma models? Thanks! ：）

gokayfem commented 8 months ago

i think so once llama-cpp-python uptaded, it will take 1-2 days probably