-
### Describe the bug
I tried both the manual install and the one click install for Linux. My OS is a fresh install of Ubuntu 24.04. I've previously used this model on Windows 10 with text-generation-…
-
I'm a noob to AI. how do we install SuperAGI in anaconda env and use a free local llm instead of an api key?
-
Hey, I love this extension and it's the main way I use Oobabooga, which is for storywriting.
I'm wondering if you'd consider adding keyboard shortcuts for common commands -- specifically, generate,…
-
1. How flexible is it with model file format compared to Oobabooga regarding GPTQ vs GGUF vs regular model file?
2. Can this read documents like GPT4All or Khoj or PrivateGPT (and maybe others)?
3. …
-
many requirements are locked to python3.7, and there are... a lot of requirements in general.
-
### What do you need?
i want to be able to change the base url to another endpoint e.g. the Azure OpenAI endpoint instead of default OpenAI
-
1. Can this work with Ollama (with or without LiteLLM) instead of Oobabooga? Maybe there are low foot-porint models like Phi-3.5 that would be applicable
2. Are there ways to adjust pre-slide word co…
-
**Description**
I saw mention of Q6 cache support many times, by the ExLlama dev and other people:
[](https://www.reddit.com/r/LocalLLaMA/comments/1dpwo0f/comment/larpk4j/)
[](https://www.reddi…
-
When I tried to build docker-cuda image I get the following error:
```
0 122.2
#0 122.2 error libmamba response code: -1 error message: Invalid argument
#0 122.2 critical libmamba failed to e…
-
Hey, neat project and/but I'm wondering how one could approach to integrating a project like this to/with the big ones like [oobabooga/text-generation-webui](https://github.com/oobabooga/text-generati…