-
### Bug Description
----> 4 from ragatouille import RAGPretrainedModel
6 READER_MODEL_NAME = "llama-2-7b-chat-hf"
8 bnb_config = BitsAndBytesConfig(
9 load_in_4bit=True,
…
-
We started experimenting with LocalAI and are very enthusiastic about it. However, we encounter slow response when we want to chat based on documents. The example we use is based on this [LangChain4j …
-
Greetings everyone,
I've been working on integrating LocalAI into Nextcloud via the Nextcloud app. Everything proceeded smoothly until a peculiar issue emerged: whenever I create an image, the mode…
-
I am opening this issue to get some help remaking the [Model Gallery](https://localai.io/models/) page on the site, if you would like to help. Please comment you input here!
-
### The Feature
Let's say OpenAI comes out with GPT-5 and it has a totally different API. Or Amazon releases a model called Bezos-AI. Users should be able to easily add support for that model's API, …
-
### Feature request
Set up template to simplify fine-tuning of embedding models.
### Motivation
[Fine-tuning](https://blog.langchain.dev/using-langsmith-to-support-fine-tuning-of-open-source-llms/)…
-
### Which version of integration_openai are you using?
1.1.4
### Which version of Nextcloud are you using?
27.1.4
### Which browser are you using? In case you are using the phone App, specify the …
-
https://huggingface.co/microsoft/phi-2
-
https://huggingface.co/coqui/XTTS-v2
-
**LocalAI version:**
quay.io/go-skynet/local-ai:v1.40.0-cublas-cuda12
**Environment, CPU architecture, OS, and Version:**
Docker Desktop, Ryzen 7 5800X3D, Nvidia 3090 FE, Windows 11
**Describe…