-
I see in the README it says:
```
There's just better alternatives that don't involve explicitly biasing the attention weight matrix, and they will be more performant on top of providing similar or …
-
-
## Description
Here I am trying to brainstorm the positional bias term, which I think could be necessary to incorporate/test at this stage.
The positional bias term could be a filter p = Conv2D of (…
-
Hi,
I really enjoyed the positional and GC bias feature in polyester. However, I would like to incorporate more customized positional and GC bias models to make capture more potential bias scenario…
-
I am unable to use the sample Mamba2 code. Even with following simple code, it fails to do forward pass.
```
import torch
from mamba_ssm import Mamba2
batch, length, dim = 2, 64, 256
x = torch.…
-
- scipyを使った実装はできている
- 正確な検定方法を論文でもう一度確認する
soh-i updated
10 years ago
-
### Checklist
- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a …
-
## Bug Description
when i use torch_tensorrt.compile transformer module with dynamic_shapes, it will occur this error,
## To Reproduce
def test_compile_v1():
model = AutoModel.from_pretrai…
-
```
def forward(self, query, key, value, pos_emb, mask):
"""Compute 'Scaled Dot Product Attention' with rel. positional encoding.
Args:
query (torch.Tensor): Quer…
-
I encounter a problem while running the command " roslaunch mms_slam mms_slam_mapping.launch"