search

WisdomShell / codeshell

A series of code large language models developed by PKU-KCL
http://se.pku.edu.cn/kcl
Other
1.62k stars 120 forks source link

flash attention 支持？ #36

Closed CaesarWWK closed 1 year ago

CaesarWWK commented 1 year ago

您好请问codeshell支持flash attention2吗？如果支持的话应该怎么开启？

ruixie commented 1 year ago

你好，开源版本未提供flash attention2的支持，如需添加可以参考flash attention2文档进行修改。