search

gokayfem / ComfyUI_VLM_nodes

Custom ComfyUI nodes for Vision Language Models, Large Language Models, Image to Music, Text to Music, Consistent and Random Creative Prompt Generation
Apache License 2.0
297 stars 23 forks source link

MoonDream2 .gguf support #61

Open Ratinod opened 3 months ago

Ratinod commented 3 months ago

Can you add support for .gguf version of MoonDream2? Currently .gguf gives an error with "LLava Clip Loader".

moondream2-mmproj-f16.gguf moondream2-text-model-f16.gguf

Specialized MoonDream2 node gives me a CUDA error (8GB VRAM not enough?).

gokayfem commented 1 month ago

They added different classes to llama.cpp for nanollava and moondream i will add them.