-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and found no similar bug report.
### Ultralytics YOLO Component
Inst…
-
### 🐛 Describe the bug
CUDA_VISIBLE_DEVICES=4 python -m vllm.entrypoints.openai.api_server --model PsyLLM-3.5-Turbo-09-19-Q3_K_M.gguf --trust-remote-code --port 6000 --host 0.0.0.0 --dtype auto…
-
Attempting to follow the python tutorial in README.md in a Google Cloud Shell environment, and I get the following error:
`
Steps to reproduce
main.py
```python
import flask
import funct…
-
### 🐛 Describe the bug
I use the following script to translate Llama-2-7b-hf to MLIR. It failed in the translation to torchscript.
```python
from transformers import AutoTokenizer, LlamaForCausal…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Current Behavior
**Error: TimeoutError('Timeout reading from socket')**
![image](https://github.com/user-at…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
- [ ] 3. Please note that if the bug-related iss…
-
i am getting this error ayone aware of it how to solve ?
`To create a public link, set `share=True` in `launch()`.
ERROR: Exception in ASGI application
Traceback (most recent call last):
F…
-
Thank you very much for the excellent work of the author!!
What is the reason for this problem?
When I open the web UI page and click on upload soil or audio, the following error appears:
ERROR: …
-
From the tutorials and recipes it looks like you can only do dynamic Int8 Int4? Also I cannot export the trained model to onnx?
```
import torch
from torchao.quantization.prototype.qat import I…
-
Command - `local-llm run meta-llama/Llama-3.2-11B-Vision 8000 --verbose`
Issues - Not able to download and run the LLM model
```
Traceback (most recent call last):
File "/home/ubuntu/.local/…