-
Build cmd:
cd /home/xu/conda_spaces/ipex_cpu/frameworks.ai.pytorch.ipex-cpu/build/Release/csrc/cpu/csrc/cpu && /usr/bin/clang++ -DAT_PARALLEL_OPENMP=1 -DUSE_C10D_GLOO -DUSE_DISTRIBUTED -DUSE_RPC -D…
-
PC Hardware:
- i7-9700kf
- Nvidia gtx 1660(6Gb)
- 16Gb memory
model used:
- TheBloke/wizardLM-7B-GPTQ
- wizardLM-7B-GPTQ-4bit-128g.no-act.order.safetensors
env:
Running in windows10 WSL2…
-
### Your current environment
```text
Collecting environment information...
PyTorch version: N/A
Is debug build: N/A
CUDA used to build PyTorch: N/A
ROCM used to build PyTorch: N/A
OS: Ubuntu …
-
Hi,
I got the following error message using OpenMPI 4.1.1 and ucx 1.10 or OpenMPI 4.0.3 and ucx1.10.
```
[n07299:125295:0:125295] ib_mlx5_log.c:145 Transport retry count exceeded on mlx5_0:1/IB …
-
### Your current environment
Collecting environment information...
INFO 08-28 14:32:56 importing.py:10] Triton not installed; certain GPU-related functions will not be available.
WARNING 08-28 14:3…
-
Im not too familiar with mul_mat, but it seem's like it is the part of the process that takes the longest time, is that able to be optimized even further?
The current speed is great for a falcon mo…
-
### Your current environment
```text
PyTorch version: 2.2.0a0+git8964477
Is debug build: False
CUDA used to build PyTorch: None
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.4 LTS (x86_64)
…
-
### 🐛 Describe the bug
When a module has a parameter which is a tensor of size 1 and you try to save its FSDP with torch.distributed.checkpoint, you get the following exception:
```
NotImplemente…
-
### Your current environment
```text
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
…
-
### What is the issue?
Tied back to #5593
[Using SYCL via llama-cpp b3038](https://github.com/ggerganov/llama.cpp/releases/download/b3038/llama-b3038-bin-win-sycl-x64.zip) I can get a clean offlo…