-
Hi, I encountered an abnormal memory usage issue when deploying Qwen2-VL-7B-Instruct using vllm. My specific configuration is as follows:
(Hi,我使用vllm部署Qwen2-VL-7B-Instruct遇到了显存占用异常的问题。我的具体配置如下)
### …
-
It would be useful to build and test on AMD x86 CPUs and not only Intel.
Thanks to @lfield and his colleagues I have had access to an AMD EPYC at CERN.
The results are in PR #238.
Note that tha…
-
### 🐛 Describe the bug
Streamreader `seek` not seeking to correct frame even with `mode='precise'`.
Use below code to reproduce the error with any audio in opus format.
This code is expected to d…
-
### 🐛 Describe the bug
1. torch.random.fork_rng(devices=rng_device) does not support XPU backend
TestRandomTensorCreationXPU.test_randperm_xpu
.Assembly).Run(a…
-
You can see one approach implemented for 64 bit integers using highway here: https://gcc.godbolt.org/z/YWx3vaTET
This needs the `MulEven`/VPMULUDQ instruction.
The function multiplies two vectors …
-
➜ ckb-miner git:(develop) cc -v
Apple LLVM version 10.0.1 (clang-1001.0.46.4)
Target: x86_64-apple-darwin18.7.0
Thread model: posix
InstalledDir: /Library/Developer/CommandLineTools/usr/bin
Foun…
-
### Describe the issue:
As of numpy 1.25, the following deprecation warning appears when setting the dtype of an array that will overflow:
> /home/sarah/dep.py:6: DeprecationWarning: NumPy will …