-
I implemented sub-quadratic attention (as described in https://arxiv.org/abs/2112.05682v2):
https://twitter.com/Birchlabs/status/1607503573906063362
https://github.com/Birch-san/diffusers/pull/1…
-
l'm having this issue every time l generate an image this message comes up "NotImplementedError: No operator found for `memory_efficient_attention_forward`"
-
This is a discussion of how to minimize memory usage of attention.
Current state: investigating apex's [scaled_masked_softmax](https://github.com/bigscience-workshop/Megatron-DeepSpeed/blob/main/me…
-
Great work on this project! I'm doing some benchmarking with key padding masking, but am getting a different answer for `xformers.components.attention.ScaledDotProduct` as compared to standard attenti…
-
I'm currently working on an API using FastAPI to serve DINOv2 models from the official DINOv2 repository. The API works well locally, but when I run it in a Docker container, I encounter an error rela…
-
# 🐛 Bug
RuntimeError: unsupported output type: int, from operator: xformers::efficient_attention_forward_cutlass
## Command
## To Reproduce
StableDiffusionXL model use with torch.jit and …
-
1.Public code and paper link:
I have installed the following code: [https://github.com/AILab-CVC/GroupMixFormer](url)
paper link : [https://arxiv.org/abs/2311.15157](url)
2. What does this work d…
-
Hello, `big_vision` team!
Thanks for your work on the repository. Looking through the code I noticed that ViT is using classical attention (see [line 91 of ViT implementation](https://github.com/go…
-
# ❓ Questions and Help
memory_efficient_attention fw produce inconsistent results
not sure what was going on? incorrect built? some specific versions combinations?
for some combinations:
xfo…
-
File "fastcomposer/fastcomposer/model.py", line 571, in forward
localization_loss = get_object_localization_loss(
File "fastcomposer/model.py", line 416, in get_object_localization_loss
r…