search

TheR1D / shell_gpt

A command-line productivity tool powered by AI large language models like GPT-4, will help you accomplish your tasks faster and more efficiently.
MIT License
9.43k stars 746 forks source link

Support for oobabooga/text-generation-webui api? #392

Closed NQDM-paul-sinclair closed 10 months ago

NQDM-paul-sinclair commented 10 months ago

Just as it supports exl2 model and seems like that would be better fit if this could use that aswel? via ooba api instead of localai possible?

NQDM-paul-sinclair commented 10 months ago

ah never mind I just found this https://github.com/oobabooga/text-generation-webui/tree/main/extensions/openai