search

bowang-lab / scGPT

https://scgpt.readthedocs.io/en/latest/
MIT License
1.05k stars 206 forks source link

AttributeError: 'MultiheadAttention' object has no attribute 'Wqkv' #247

Open yuhan1li opened 2 months ago

yuhan1li commented 2 months ago

image

Tom-900 commented 1 month ago

Hi! I also encontered such issue. You need to install flash-attn (e.g., flash-attn==1.0.2) to let the self_attn equipped with layer .Wqkv()