-
### Your current environment
vLLM Version: 0.6.3.post2.dev256+g4be3a451
The output of `python collect_env.py`
```text
Collecting environment information... …
-
### 🐛 Describe the bug
torch.hsmm/torch.hspmm/torch.hsmm triggered a crash with out-of-bound indices
minimal example:
```
https://colab.research.google.com/drive/1Rrhc-NvKzRbhNYbJvlXWeP6S8syLBT…
x0w3n updated
1 month ago
-
### Describe the bug
To finetune model on Xeon CPU, we are following the [ai-reference-models/models_v2/pytorch/llama/training/cpu at main · intel/ai-reference-models (github.com)](https://github.com…
-
### 🐛 Describe the bug
with TP
![Screenshot 2024-10-08 at 6 41 21 AM](https://github.com/user-attachments/assets/31421762-5742-4184-a52f-36a5de388eaf)
without TP
![Screenshot 2024-10-08 at 4 19 …
-
### 🐛 Describe the bug
# Bug program
```
import torch
# CPU
input = torch.randn(3, 4, 5)
running_mean = torch.randn(4)
output, save_mean, save_var, reserve, _ = torch._batch_norm_impl_index…
-
I'm currently trying out the ollama app on my iMac (i7/Vega64) and I can't seem to get it to use my GPU.
I have tried running it with num_gpu 1 but that generated the warnings below.
`
2023/11/…
-
Suspected to be alignment issue on DoDemul [line 141](https://github.com/jianding17/Agora/blob/d090d16d7e7ae1fc91df6caf3a4996769a9c0e97/src/agora/dodemul.cc#L141) ( _mm512_store_ps(dst + j * cfg_->Bs…
-
Hi,
I built a windows debug version of embree 3.13.1 using these commands:
```
cmake -G "Visual Studio 16 2019" -T "Intel C++ Compiler 19.2" ^
-DTBB_ROOT="E:/tmp/embree/tbb2017_20161128oss_win…
-
**Describe the bug**
Recently started hitting a new issue on boot where I see the boot operation back out and get internally rerun many times, before eventually proceeding and hitting a General Pro…
-
Build following instructions in BUILDING.md with:
**cd libjxl
mkdir build
cd build
cmake -DCMAKE_BUILD_TYPE=Release -DBUILD_TESTING=OFF ..**
-- The C compiler identification is GNU 10.2.1
-- The…