-
I am trying to run the summarization example as is - however that fails since the device of outlines.transformers is not set to cuda.
The example uses model "TheBloke/Mistral-7B-OpenOrca-AWQ" which r…
-
Je souhaite tester https://github.com/imartinez/privateGPT
-
**Environment, Container Image, Hardware**
LocalAI version: 2.14.0
Container Image: localai/localai:v2.14.0-cublas-cuda12-ffmpeg
nvidia CUDA 12, intel x86_64, Ubuntu 22.04 LTS.
Linux makin…
-
Darwin Feedloops-Mac-Studio.local 23.2.0 Darwin Kernel Version 23.2.0: Wed Nov 15 21:55:06 PST 2023; root:xnu-10002.61.3~2/RELEASE_ARM64_T6020 arm64
example my public ip is: http://36.54.42.112
…
-
i ran the script below and tried to increase the context size of my model and i got this error
what do you think is the possible issue
### Steps/code to reproduce the bug:
```python
…
-
### Discussed in https://github.com/nomic-ai/gpt4all/discussions/1680
Originally posted by **HLDMYBR** November 25, 2023
I'm currently using Mistral OpenOrca with multiple chats. If I change t…
-
### Bug Report
I upgraded the app from 2.70 to 2.71, and first Windows Defender gave me a virus notification and removed some files and then the app stopped working.
### Steps to Reproduce
U…
-
Как добавить форматирование промпта для модели?
Некоторые модели тренируются с определенным шаблоном промпта. Например возьмем модель [Open-Orca/Mistral-7B-OpenOrca](https://huggingface.co/Open-Orc…
-
I tried to update GPT4All to fix the issues with the recent packages. Some old models are not supported any more, many new models are now available. GPT4All describes the supported local models, with …
-
### Describe your problem
Hello Ragflow team,
I am encountering an issue where the AI responses I receive when using ollama through Ragflow are significantly shorter and less detailed compared to …