issues
search
FlagOpen
/
FlagAttention
A collection of memory efficient attention operators implemented in the Triton language.
Other
201
stars
15
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Is it possible for your team to implement xformers.ops.memory_efficient_attention?
#24
radna0
opened
1 month ago
5
Supporting memory efficient dropout in flash attention
#23
tongxin
closed
3 months ago
0
support grouped query attention(MQA & GQA) for flash_attn
#22
iclementine
closed
3 months ago
0
Feishu bot test
#21
StrongSpoon
closed
5 months ago
0
add paged-attention
#20
kaiyuanm
closed
6 months ago
0
update README and fix typos
#19
iclementine
closed
7 months ago
0
add logo for flag-attention & link to flag-open
#18
iclementine
closed
7 months ago
0
Add flash decoding(flash attention with split_kv)
#17
iclementine
closed
7 months ago
0
add workflow & precommit
#16
iclementine
closed
7 months ago
0
Add workflow and pre-commit
#15
iclementine
closed
7 months ago
0
Test
#14
iclementine
closed
7 months ago
0
fix a bug in config selection introduced in PR #9
#13
iclementine
closed
7 months ago
0
Change the causal masking when seqlen_q > seqlen_kv
#12
iclementine
closed
7 months ago
0
support seqlen_q > seqlen_kv
#11
iclementine
closed
7 months ago
0
add options to retutn log normalizer & total attention
#10
iclementine
closed
7 months ago
1
refactor the code to allow overwriting the function to get config
#9
iclementine
closed
8 months ago
0
fix a bug in upper bound of kernels that loop along tiles in a row
#8
iclementine
closed
8 months ago
0
Feature request: Add Dropout
#7
hypnopump
opened
8 months ago
4
add testing for non divisible m & non-divisible n
#6
iclementine
closed
8 months ago
0
Hypno/add bias
#5
hypnopump
opened
8 months ago
6
Comparison with triton-included flash attention2
#4
hypnopump
closed
8 months ago
2
Flash Attention 2: Save mask application if block is not in boundary
#3
hypnopump
closed
8 months ago
5
Optimization of operators
#2
iclementine
closed
9 months ago
0
fix error in pointer computation _bwd_preprocess
#1
iclementine
closed
10 months ago
0