-
## 🐛 Bug
Hi guys!
In Linformer's example source code, I found that operation order may not match the official paper mathematics.
[Here, in the code](https://github.com/pytorch/fairseq/blob/m…
-
In the setup that is not Linformer:
https://github.com/lucidrains/linear-attention-transformer/blob/dd3f7b63fe2235cba97ab1a95840d0484c70c068/linear_attention_transformer/linear_attention_transformer.…
-
`..installing git+https://github.com/facebookresearch/xformers.git@main#egg=xformers
error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully.
│ exit cod…
-
Hello!
I would like to ask you, whether you've done the experiments on the memory consumption of the elaborated models and its comparison with each other?
-
Hello,
1.- In your transfuser paper you report the mean and std dev over 9 runs of each method (3 training seeds, each seed evaluated 3 times). Does this mean that you changed the `REPETITIONS` value…
-
微博内容精选
-
# ❓ Questions and Help
Hello,
I tried to compile xformers on a rented gpu from vast.ai with
`%pip install git+https://github.com/facebookresearch/xformers@1d31a3a#egg=xformers`
and got this big e…
-
Hi,
Thank you for this very clean repository! I wonder whether any checkpoints will be released? If yes, I'm interested in adding those to the HuggingFace Transformers library (the Reformer and Lon…
-
Hi, Thanks for this nice work. Recently, I am trying to modify this excellent model to make it suit for my work. As you see, why the "average" operation is required here, the shape of the tensor chang…
-
Nice work ! I like all the easy way to work !
When I use olive optimize --optimization_config
It shows the error
```
ping: f18055a335670616d6b7454564d744e304d354f44746e64576c716154747462.s…