lucidrains perceiver-pytorch issues

lucidrains / perceiver-pytorch

Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch

MIT License

1.1k stars 134 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

TypeError: ~ (operator.invert) is only implemented on integer and Boolean-type tensors

#68 rajoy99 opened 8 months ago
0
Weight sharing not consistent with paper

#67 gshaikov opened 1 year ago
0
Perceiver IO wrong ouput dims (fully connected layer (nn.Linear) not applied)

#66 VladPetk closed 1 year ago
3
FlashAttention implementation

#65 kklemon opened 1 year ago
2
Perceiver-Pytorch for Time Series Problem

#64 HasnainKhanNiazi closed 1 year ago
0
Issue defining base in fourier_encode for experimental.py, gated.py, mixed_latents.py

#63 TannerLaBorde closed 1 year ago
1
Trainer

#62 PanayiotaK opened 2 years ago
1
Audio + Text data?

#61 Sidz1812 opened 2 years ago
1
PerceiverAR?

#60 siddk closed 2 years ago
5
Add dtype in axis_pos creation to allow precision=16 training

#59 lsisoft closed 2 years ago
0
Weight sharing implementation

#58 yuanmao closed 2 years ago
1
Dropout layer position not consistent with the original implementation

#57 yuanmao closed 2 years ago
1
just a suggestion

#56 seyeeet opened 3 years ago
4
how to use this repo for image cls ?

#55 minmummax opened 3 years ago
0
What should I change if I want to use data with input size 720*184

#54 Oussamab21 opened 3 years ago
0
Question regarding queries dimensionality in Perceiver IO

#53 pcicales opened 3 years ago
3
Positional encoding frequency bands should be linearly spaced

#52 djl11 closed 3 years ago
2
Bug in fourier_encode (?)

#51 marcdumon closed 3 years ago
2
Example for PerceiverIO with embeddings

#50 AljoSt opened 3 years ago
0
Percevier_IO mask

#49 xesdiny opened 3 years ago
2
Source for the gated GELU MLP

#48 breuderink opened 3 years ago
1
Not using the classification head in Perceiver

#47 gegallego closed 3 years ago
4
Attention softmax is applied to incorrect dimension?

#46 breuderink closed 3 years ago
2
Can we get more examples for PerceiverIO?

#45 HWiese1980 opened 3 years ago
1
How to solve with audio+video for classification?

#44 Yinjie-ZHENG opened 3 years ago
0
Add Multi-Modality PerceiverIO

#43 jacobbieker closed 3 years ago
0
Normalization happens before layers instead of afterwards

#42 SurrealEverything closed 3 years ago
3
PerceiverIO should have the option to not do cross attends in the "Process" module

#41 SurrealEverything closed 3 years ago
1
Caching mistake

#40 SurrealEverything closed 3 years ago
0
How to use this model for point cloud?

#39 sangyx opened 3 years ago
2
Decoder Attention Module needs a FF network as well in perceiver_io.py script

#38 Hritikbansal closed 3 years ago
4
question about norm_context

#37 XiaoyuShi97 opened 3 years ago
1
Adding docstring to Perceiver.init() and adding missing arguments to README :)

#36 JackKelly closed 3 years ago
0
Kinetics Pre-trained weights

#35 brandonclark314 opened 3 years ago
1
Can someone provide a small demo for training the perceiver on audio data ?

#34 nikhilbyte opened 3 years ago
0
function: cache_fn

#33 mohammad-al-zoubi closed 3 years ago
0
Training perceiver for image/ video features

#32 sauradip opened 3 years ago
1
Differences with Perceiver Preprint

#31 fac2003 closed 3 years ago
1
Pretrained model weights

#30 philippschw opened 3 years ago
2
Starting point of position encoding

#29 ohwi closed 3 years ago
2
Using model for image processing

#28 dejanberic opened 3 years ago
0
how can we use this model for 3d voxel?

#27 suman560 opened 3 years ago
2
Model implementation only allows latent transformers with one block

#26 wzhang2022 closed 3 years ago
2
Positional encoding are already part of the input

#25 Atlis closed 3 years ago
4
The parameter cross_dim in Perceiver has not been used anywhere in the forward pass

#24 KulkarniKaustubh closed 3 years ago
1
Add tests

#23 fac2003 closed 3 years ago
1
Commented version originally by batrlatom

#22 zitterbewegung opened 3 years ago
0
example of object detection on very simple image

#21 batrlatom opened 3 years ago
0
Colab notebook using perciever-pytorch

#20 zitterbewegung opened 3 years ago
4
torchscript / onnx export ?

#19 batrlatom opened 3 years ago
1