EntityinArray
commented
2 hours ago until oogabooga is supported, you can try importing GGUF models into Ollama https://github.com/ollama/ollama/blob/main/docs/import.md#Importing-a-GGUF-based-model-or-adapter
ollama is good but limited.. with oogabooga text-generation-webui users are able to load an amazing amount of gguf models which work better than some of the ollama models due to being built specifically to run on consumer grade tech. Is there any chance of us seeing oogabooga endpoints as a way to connect models to minecraft?