-
I am running ollama on i7-14700K, which supports AVX2 and AVX_VNNI, and a GeForce RTX 1060.
After reading #2205, I enable `OLLAMA_DEBUG=1` to check if ollama utilize AVX2 of this CPU. But unlike th…
-
I have a intel CPU that supports a number of AVX features, but most of them are not picked up when using ollama. Below is the llama.log file:
system info: AVX = 1 | AVX2 = 0 | AVX512 = 0 | AVX512_…
-
Hello,
its possible to install it on Jetson orin agx ? (its nvidia tpu) ubuntu aarch64 (arm64) ?
if yes, can you explain me how ??
thanks you
-
Greetings everyone,
I've been working on integrating LocalAI into Nextcloud via the Nextcloud app. Everything proceeded smoothly until a peculiar issue emerged: whenever I create an image, the mode…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [X] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of…
-
Hello,
I was trying to use kompute, I manage to compile llamacpp kompute with the follow steps
```
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp/
#install kompute repo…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I am able to successfully receive a response running the following code, however, the re…
-
Does it have something to do with **tensorflow**?
And it's weird that from the following console messages,
- It took **PrivateGPT** 51 seconds to answer 1 single question ?????
- Unable to regis…
-
**LocalAI version:**
v2.7.0-3-g555bc02 (555bc0266530ceaa4edb3624fe970c88c497ffab)
**Environment, CPU architecture, OS, and Version:**
Tried with GPU (Google Cloud n1-standard-8 - Azure Standard D…