-
### What is the issue?
Hardware has 11.1 GiB (RAM) + 1.9 GiB (GPU) = 13 GiB, but fails to run a 3B model.
Any idea why?
```
Nov 14 17:49:49 fedora ollama[1197]: r14 0x6
Nov 14 17:49:49 fedor…
-
After running `.\tabby.exe serve --model StarCoder-1B --chat-model Qwen2-1.5B-Instruct` after downloading the models, the llama-server.exe crashes.
Tabby
tabby v0.18.0 and tabby v0.19.0-rc.1
tabb…
-
### What is the issue?
qwen4b works fine, all other models larger than 4b are gibberish
```
time=2024-09-05T11:35:49.569+08:00 level=INFO source=download.go:175 msg="downloading 8eeb52dfb3bb in 1…
cyear updated
2 weeks ago
-
Hello,
i have got a issue while runnning ollama on the A380 gpu.
This log snippet is from the ollama log while executing a prompt from open-webui.
The system runs:
Fedora 39
Kernel 6.10.7
…
-
### What is the issue?
While running mixtral:8x7b-instruct-v0.1-q4_K_M on my physical machine with x3 7900 XTX I got this error:
```
[root@5dc6ecf27031 /]# ollama run mixtral:8x7b-instruct-v0.1-…
-
When I run the run.sh in 3_train in example, there occurs the error below:
Traceback (most recent call last):
File "/public/home/yika/miniforge3/envs/deepH3/bin/deeph-train", line 8, in
sys.…
-
Hi,
The scripts train_trades_mnist.py and train_trades_cifar10.py don't include the following:
*Code to save the best checkpoints
*The folllwing evaluation:
`train_loss, train_acc = eval_train(arg…
-
## ❓ Questions and Help
Hi, I recieved loss None when training model. Anyone can help?
Simple reproduct kaggle notebook [link](https://www.kaggle.com/code/liondude/notebook548442067d)
```
im…
-
### Before submitting your bug report
- [X] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue](ht…
-
**A potential design:**
1. add an argparse option for `--num-layers-override` in infer.py https://github.com/NVIDIA/bionemo-framework/blob/main/sub-packages/bionemo-geneformer/src/bionemo/geneformer/s…