About Flash Attn's version

huggingface / alignment-handbook

Robust recipes to align language models with human and AI preferences

https://huggingface.co/HuggingFaceH4

Apache License 2.0

4.2k stars 357 forks source link

About Flash Attn's version #85

Open chengjl19 opened 6 months ago

chengjl19 commented 6 months ago

I encountered this error (importerror: /flash_attn_2_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol) and I tried many ways to solve it but failed. Could you kindly share your version of flash-attn?

lewtun commented 6 months ago

Hello @chengjl19 we are using flash-attn==2.3.6 and will ping this in the linked PR. If you have trouble installing it via pip have you tried installing from source?