search

xXAdonesXx / NodeGPT

ComfyUI Extension Nodes for Automated Text Generation.
GNU Affero General Public License v3.0
339 stars 25 forks source link

Questions on NodeGPT #28

Open TomLucidor opened 11 months ago

TomLucidor commented 11 months ago
  1. How flexible is it with model file format compared to Oobabooga regarding GPTQ vs GGUF vs regular model file?
  2. Can this read documents like GPT4All or Khoj or PrivateGPT (and maybe others)?
  3. Are there nodes for downloading models from HF, caching them, and loading them if they are locally stored?
  4. Can this support Langchain and LlamaIndex? What about the online functions of BabyAGI and AgentGPT?
  5. What is with Flowise and other "drag and drop" service?
daniel-lewis-ab commented 11 months ago

I can only speak to 3. The answer is yes. There's a folder you can put GGUF files and have it correctly load and run the model from HF.

TomLucidor commented 11 months ago

@daniel-lewis-ab this relies on Oobabooga being on right? if that is the case then is this Pinokio (and maybe Stability Matrix) compatible?

daniel-lewis-ab commented 11 months ago

Tom,

I was referring to using llama-cpp-python to load the models.

I actually have a pull request in the wings, but comfyanonymous wasn't getting back to me for a while for some reason, maybe he was busy. I had some ideas to fix some aspects of the llama-cpp-python node.

On Sun, Dec 31, 2023 at 2:00 AM TomLucidor @.***> wrote:

@daniel-lewis-ab https://github.com/daniel-lewis-ab this relies on Oobabooga being on right? if that is the case then is this Pinokio (and maybe Stability Matrix) compatible?

— Reply to this email directly, view it on GitHub https://github.com/xXAdonesXx/NodeGPT/issues/28#issuecomment-1872878731, or unsubscribe https://github.com/notifications/unsubscribe-auth/AC36LN6PAP3TDOWCDLKWIX3YMESSPAVCNFSM6AAAAABAOJLYWKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNZSHA3TQNZTGE . You are receiving this because you were mentioned.Message ID: @.***>