lucidrains h-transformer-1d issues

lucidrains / h-transformer-1d

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

MIT License

154 stars 21 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

error in test

#25 jizhang02 closed 7 months ago
1
Billion Word Benchmark - Reproducibility

#24 DavidHerel opened 1 year ago
0
Use for relatively short sequences and small datasets

#23 Vedasheersh opened 1 year ago
0
Number of processed inputs in causal version is off

#22 vladyorsh opened 1 year ago
2
Fix indexing

#21 jglaser opened 2 years ago
1
Approximated values are off

#20 jglaser opened 2 years ago
2
add key_value_mask argument for cross attention

#19 jglaser closed 2 years ago
5
Masking not working in training, thanks

#18 junyongyou closed 2 years ago
6
Sequence classfication, thanks a lot

#17 junyongyou closed 2 years ago
0
Add Norm Missing

#16 wwx13 closed 3 years ago
2
Mask not working

#15 wwx13 closed 3 years ago
2
Multiple applications of positional embeddings?

#14 Clemens123 closed 3 years ago
1
Algorithm Mismatch

#13 jinmang2 closed 3 years ago
3
Application to sequence classification?

#12 trpstra closed 3 years ago
4
Does its model include relative position embedding?

#11 hadaev8 closed 3 years ago
1
One simple question

#10 CiaoHe closed 3 years ago
2
eos token does not work in batch mode generation

#9 tmphex closed 3 years ago
4
Sequence length issue when `causal = True`

#8 jaak-s closed 3 years ago
1
Does h-transformer-1d have a subquadratic cost?

#7 jinmang2 closed 3 years ago
1
RuntimeError: Tensor type unknown to einops <class 'torch.return_types.max'>

#6 wajihullahbaig closed 3 years ago
4
ModuleNotFoundError: No module named 'rotary_embedding_torch'

#5 wajihullahbaig closed 3 years ago
1
Mini-batching (b > 1) does not work with masking

#4 jaak-s closed 3 years ago
2
Example in README does not work

#3 jaak-s closed 3 years ago
2
H-Transformer for Cross-Attention?

#2 Vbansal21 closed 3 years ago
4
I have some questions about implementation details

#1 jinmang2 closed 3 years ago
3