-
Hey There, appreciate what you guys are doing, its great work.
I'm trying to access the model weights from HF using transformer Library but stuck due to a swiglu error, any help regarding that would…
-
### 🚀 The feature, motivation and pitch
Hey team, i love building things from scratch, and as i was implementing the LLaMa paper by meta obviously using pytorch i saw that pytorch did not have a nn.s…
-
Hi! Thank you for your amazing work!
I'm having some trouble on comparing the fused swiglu kernel with its plain pytorch version.
I checked the wall clock time with code below, and it gives me l…
-
# ❓ Questions and Help
Hi All,
Debian 13
python3.10.12 venv
PyTorch2.4.1_rocm
When I try and compile xformers against Pytorch2.4.1_rocm I am ending up with the common "no file found at /th…
-
### Describe the feature
https://github.com/linkedin/Liger-Kernel
Liger Kernel is a collection of Triton kernels designed specifically for LLM training. It can effectively increase multi-GPU train…
-
# ❓ Questions and Help
Some features appear to be unavailable when executing 'python -m xformers.info' (cutlassF, smallkF, ...)
Is this normal?
```
xFormers 0.0.27+7a04357.d20240822
memory_ef…
-
### 🐛 Describe the bug
https://github.com/linkedin/Liger-Kernel/blob/e249eee723978bf8610ff1ea2297d048a2417e20/test/transformers/test_swiglu.py#L46
https://github.com/linkedin/Liger-Kernel/blob/e24…
-
I am installing xformers by the following steps:
```bash
git clone https://github.com/ROCm/xformers
cd xformers
git checkout develop
git submodule update --init --recursive
python setup.py ins…
-
谢谢您在别的issue的解答!
(cdfsod) h@hn:~/wang/projects/CDFSOD-benchmark$ bash build_prototypes.sh
prototypes_init folder already exists.
PYTHONPATH: None
Using cache found in /home/h/.cache/torch/hub/face…
-
In recent PyTorch 2.2.0 release, they have deprecated NVFuser in torch script with this [warning](https://github.com/pytorch/pytorch/blob/v2.2.0/torch/csrc/jit/python/init.cpp#L759-L762). See this [co…