-
-
### Checklist
- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [X] The issue is caused by an extension, but I believe it is caused b…
-
### System Info
```Shell
- `Accelerate` version: 0.30.0
- Platform: Linux-6.5.0-27-generic-x86_64-with-glibc2.35
- `accelerate` bash location: /data/envs/tt/bin/accelerate
- Python version: 3.10.1…
-
### Your current environment
vllm(0.3.3) on ray(2.10.0) cluster deployed by docker on 2 nodes with 2 GPU(Tesla T4) each.
linux environment
root@ai151:/vllm-workspace# env
NV_LIBCUB…
-
**Describe the bug**
Quantization seems to have finished. So maybe this error can be ignore, but posting just to be safe so maybe folks here can verfiy.
**GPU Info**
1x A100 40GB
![image](http…
-
Hi,
I ran the example with 4xA100 system and encountered the following issue. Please advise how can I resolve this issue? Thanks
python examples/text-generation/llama.py --hub-token ${HF_TOKEN} me…
-
### What is the issue?
The process never completes when I try to do ollama run or ollama list.
### OS
Windows
### GPU
Nvidia
### CPU
Intel
### Ollama version
0.3.12
-
I get this error when running '!python agent.py --config config.yaml'
/content/muzic/musicagent
2023-12-04 10:03:54.786370: I tensorflow/core/platform/cpu_feature_guard.cc:193] This TensorFlow bin…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch…
-
### Checklist
- [ ] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a …