-
### What is the issue?
While running mixtral:8x7b-instruct-v0.1-q4_K_M on my physical machine with x3 7900 XTX I got this error:
```
[root@5dc6ecf27031 /]# ollama run mixtral:8x7b-instruct-v0.1-…
-
```c
#pragma GCC push_options
#pragma GCC target("arch=armv8.6-a+simd+bf16")
#pragma clang attribute push(__attribute__((target("arch=armv8.6-a+simd+bf16"))), apply_to = function)
void simsimd_k…
-
### What happened?
I am trying to run Qwen2-57B-A14B-instruct, and I used llama-gguf-split to merge the gguf files from [Qwen/Qwen2-57B-A14B-Instruct-GGUF](https://huggingface.co/Qwen/Qwen2-57B-A14B-…
-
**Check List**
- [x] The binary I am trying to run has been compiled statically for either RV64 or AArch64.
- [x] The compiled binary is a Linux Elf file.
- [x] I have provided both a config fil…
-
Hello,
i have got a issue while runnning ollama on the A380 gpu.
This log snippet is from the ollama log while executing a prompt from open-webui.
The system runs:
Fedora 39
Kernel 6.10.7
…
-
Nemo Mistral error : there was an error with the local ollama instance
(base) ferran@z590i:~$ flatpak run com.jeffser.Alpaca
çF: Not sharing "/usr/share" with sandbox: Path "/usr…
-
https://tone.aliyun-inc.com/ws/xesljfzh/test_result/370622?tab=1
【环境准备】
```
BINARY_URL=oss://compiler-ci-bucket/ajdk8/CI/tar/20240906-003517-221-#1102-linux.aarch64.release.master-ba5ab25c30b0…
-
This happens with version 0.24.8. I am using a M1 MacBook Pro with `rustc 1.75.0 (82e1608df 2023-12-21)`.
Running the program that brings up this issue results in `zsh: illegal hardware instruction…
-
**Is your feature request related to a problem? Please describe.**
The current deployed version of instructlab requires llama_cpp version 0.2.79, and I want to run the new IBM Granite architecture, w…
-
All modern SIMD instruction sets provide an instruction to shuffle bytes of one of more SIMD registers using indices from another SIMD register. Such instructions can be used to do parallel table look…