Modify flash-attn version

OpenGVLab / Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

https://vchat.opengvlab.com/

MIT License

2.85k stars 230 forks source link

Closed HenryHZY closed 2 months ago

HenryHZY commented 2 months ago

As mentioned in video_chat2/models/blip2/modeling_llama_mem.py:

from flash_attn.flash_attn_interface import flash_attn_varlen_qkvpacked_func # flash_attnv2

Andy1621 commented 2 months ago

Awesome!