-
### Your current environment
```text
The output of `python collect_env.py`
(vllm-openvino) yongshuai_wang@cpu-10-48-1-249:~/models$ python collect_env.py
Collecting environment information...
…
-
### Your current environment
```text
PyTorch version: 2.3.1+cu118
Is debug build: False
CUDA used to build PyTorch: 11.8
ROCM used to build PyTorch: N/A
OS: Debian GNU/Linux 11 (bullseye) (x86…
-
### Issue
There was a recent thread/blogpost about cursor.sh's recent 'fast apply' changes:
- https://x.com/amanrsanger/status/1790947733899203027
- https://cursor.sh/blog/instant-apply
- > Ou…
-
### What happened?
Greetings,
I am facing a problem that surfaced up
-
### System Info
Python 3.10.11
transformers 4.40.0
torch 2.0.1
Linux version 4.15.0-55-generic x86_64
### Who can help?
@ArthurZucker @gante
### Information
- [ ] The official example scripts
…
-
### Your current environment
The output of `python collect_env.py`
(vllm code copied from this PR (@84789334a) was used: https://github.com/vllm-project/vllm/pull/8574)
```text
Collecting…
-
OctoAI use vLLM as a benchmark to demonstrate how fast they are https://octo.ai/blog/acceleration-is-all-you-need-techniques-powering-octostacks-10x-performance-boost:
| Single User Throughput | Mu…
-
### Your current environment
The output of `python collect_env.py`
```text
Your output of `python collect_env.py` here
```
### Model Input Dumps
_No response_
### 🐛 Describe the bug
…
-
Unfortunately this discussion [started in Error handling thread](https://github.com/keean/zenscript/issues/40#issuecomment-390693316).
And the discussion derived from [a post I made](https://github…
-
### Your current environment
vllm 0.5.3.post1
vllm-flash-attn 2.5.9.post1
### 🐛 Describe the bug
(agiclass) root@autodl-container-c9174bac52-9e5578…