-
### Already reported ? *
- [X] I have searched the existing open and closed issues.
### Regression?
No
### System Info and Version
System/Version info
```sh
Hyprland, built from br…
-
**Please describe the feature you want**
I've been using a large completion model with my GPU. I'd like to add a chat model as well, but there's not enough GPU memory for the large completion model…
jtbr updated
2 months ago
-
I'm running llamafile 0.8.1 on a Windows 10 mini PC with a AMD Ryzen 9 5900HX CPU
CPU Architecture: AMD Cezanne (Zen 3, Ryzen 5000)
GPU: AMD Radeon RX Vega 8
The mini PC has 64GB RAM installed.…
-
### What happened?
I wanted to use the Kompute version to run on my GPU (Radeon RX570 4G) but whenever i use the `-ngl` argument to offload to GPU, `llama-cli` silently exits before loading the model…
-
I noticed that every time I called "paginationEmbed()" I would receive an error stating that the Interaction has already been "sent or deferred". I dug around the code and found that commit 95a0108 in…
-
### Describe the bug
Crash with abort when trying to use AMD graphics card in editor
Model is mistral-7b-instruct-v0.2.Q4_K_M.gguf
ggml_cuda_init: found 1 ROCm devices:
Device 0: AMD Radeon RX…
-
**Describe the bug**
Nightly and 0.17.0 fail in all tried modes (`rocm`, `cpu`) with the same message - on Windows.
**Information about your version**
```
tabby 0.17.0
tabby 0.18.0-dev.0
```
…
spock updated
1 month ago
-
### Is there an existing issue for this?
- [X] I have searched the tracker for existing similar issues and I know that duplicates will be closed
### Describe the Issue
When attempting to conn…
-
### What happened?
I've already quantized a 2b variant of this model, and one of its instruct fine tune, on a subset of the same data (the first 1000 samples are the same in the same order -- the e…
-
```
QT_ROOT_DIR: D:\Qt\6.8.0\msvc2022_64\bin\qmake.exe
QT_PLUGIN_PATH: D:\Qt\6.8.0\msvc2022_64\bin\qmake.exe\plugins
QML2_IMPORT_PATH: D:\Qt\6.8.0\msvc2022_64\bin\qmake.exe\qml
```
…