Closed YanxiZSQ closed 9 months ago
I found these functions have been renamed: Upgrading from FlashAttention (1.x) to FlashAttention-2
flash_attn_unpadded_func -> flash_attn_varlen_func flash_attn_unpadded_qkvpacked_func -> flash_attn_varlen_qkvpacked_func flash_attn_unpadded_kvpacked_func -> flash_attn_varlen_kvpacked_func
the composer_llama.py 818 line still use flash_attn_interface.flash_attn_varlen_func
run llmshearing/scripts/pruning.sh on A100 have an error