if-ai / ComfyUI-IF_AI_tools

ComfyUI-IF_AI_tools is a set of custom nodes for ComfyUI that allows you to generate prompts using a local Large Language Model (LLM) via Ollama. This tool enables you to enhance your image generation workflow by leveraging the power of language models.
https://ko-fi.com/impactframes
366 stars 27 forks source link

How to install other models other than with "ollama run modelName"? #49

Closed CoUIfy closed 2 weeks ago

CoUIfy commented 2 weeks ago

Hello, This repo recommands several models that do not exist in the official supported list of models for ollama, for example Proteus-RunDiffusion and also a alternate version of nous hermes that do not exist here: https://ollama.com/library My question is how do we install the other models that are recommanded here?

Thanks

if-ai commented 2 weeks ago

Yes the other models are meant for other engines you can look for models on the Ollama website. but for SD prompts you can use my https://ollama.com/impactframes/llama3_ifai_sd_prompt_mkr_q4km and for Image prompting ollama run llava:7b-v1.6-mistral-q4_K_M The Proteus model is just a recommendation of an SD model that can understand prompts as SD3 comes out in a few days I expect even better models will be available soon the links are in the description https://huggingface.co/dataautogpt3/ProteusV0.4

CoUIfy commented 2 weeks ago

Just to make sure I understand coreclty, you were suyggestin SD models, and not LLMs? So what is the BEST LLM model you suggest (for making good prompts). The one you mentioend laalabva mistral one I suppose?

if-ai commented 2 weeks ago

Yes, there if prompt MKR is good a making prompts, then a Llava 1.6 if you want to play with images since you need a multimodal model for understanding images finally a good SD model to create images. But it works with other models aswell.