search

dvlab-research / LLaMA-VID

Official Implementation for LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models
Apache License 2.0
622 stars 39 forks source link

flash-attn #65

Closed ismailukman closed 4 months ago

ismailukman commented 4 months ago

Hi everyone, I would like to confirm which version of flash-attn was used... currently i get the following error in all the versions i have tried.

ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

Thanks in advance

yanwei-li commented 4 months ago

Hi, we use flash-attn==2.1.2.post3

ismailukman commented 4 months ago

Thanks, this worked!