-
Hello,
I'm trying to fine-tune 'unslothai/tinyllama-bnb-4bit' model.
Now I'm using a Trainer class from transformers library.
I have 2 x RTX3090 gpu, but i only use 1 gpu.
Can u give me a solut…
-
-
I am trying to use GLABlock with batch size 1, but encounter this error. How can I resolve this?
My current config:
```
config = GLAConfig(
hidden_size=channels,
num_hidden_layers=n_…
-
oneapi 2024.0, Ubuntu22.04, A770
if modify model.to('xpu') to model.to('cpu'), the code can work.
if model.to('xpu'), it will get error
```
# python minicpm-v2.py
/root/miniconda3/envs/llm/li…
-
Which is the improvement with the new function new_coords over traditional yolov4?
Did someone try it with COCO?
```
If you do not get an answer for a long time, try to find the answer among Issu…
-
**Describe the bug**
On installing, Fusion 360 pops a dialog saying that it needs WebView2 to continue.
**To Reproduce**
1. Follow the install process, default options, no extensions selected
2.…
deece updated
7 months ago
-
I've been trying to investigate why my information extraction program with SGLang is so slow. I've rented RTX3090 (1 x RTX 3090, 6 vCPU 26 GB RAM) and H100 (1 x H100 SXM, 16 vCPU 125 GB RAM) on RunPod…
-
Hello sir. Thank for your hard working. I have some question here.
Here is the model config
```python
config = MambaConfig(
vocab_size=256,
d_state=16,
d_model=1024,
…
-
### Discussed in https://github.com/open-webui/open-webui/discussions/3213
Originally posted by **albertmkc** June 16, 2024
I used the command as suggested on Ollama.com to run locally in Wind…
-
Epoch [1/3]
---------------------------------------------------------------------------
KeyError Traceback (most recent call last)
File :21, in _fwd_kernel(Q, K, V,…