-
### Proposal to improve performance
Test new feature medusa speculative sampling with [vllm v0.5.2](vllm-openai:v0.5.2).
After using Medusa speculative sampling, the performance dropped significantl…
-
### Project Version
3.2.6
### Platform and OS Version
windows 11
### Affected Devices
Amd RX 580
### Existing Issues
_No response_
### What happened?
i am, on amd gpu . my g…
-
**Describe the bug**
```
Finished dev [unoptimized + debuginfo] target(s) in 0.33s
warning: the following packages contain code that will be rejected by a future version of Rust: nom v4.1.1
note: …
-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussi…
-
### Your current environment
```text
The output of `python collect_env.py`
Collecting environment information...
WARNING:root:libtpu.so and TPU device found. Setting PJRT_DEVICE=TPU.
INFO 11-04…
-
(minigpt4) C:\MINIGPT\MiniGPT-4>python demo.py --cfg-path eval_configs/minigpt4_eval.yaml --gpu-id 0
Initializing Chat
Loading VIT
Loading VIT Done
Loading Q-Former
Loading Q-Former Done
Loadin…
-
### 🐛 Describe the bug
Re-triage it by cbb4ab17. Old issue is https://github.com/intel/torch-xpu-ops/issues/280
# AssertionError: Jiterator is only supported on CUDA and ROCm GPUs, none are availa…
-
Because implementing all features is not necessarily interesting unless there is a need for it, here are the current restrictions of the code in its current version. **All these restrictions can be li…
EiffL updated
2 weeks ago
-
I have cuda 9.0 installed too and I have /usr/local/cuda pointed to cuda-9.0 dir. But in my bashrc, I updated env params as following -
```
export PATH=/usr/local/cuda-9.2/bin${PATH:+:${PATH}}
e…
-
llama-stack install from source:https://github.com/meta-llama/llama-stack/tree/cherrypick-working
### System Info
python -m "torch.utils.collect_env"
/home/kaiwu/miniconda3/envs/llama/lib/pytho…