Code change to use flash attn 2

OpenBMB / ToolBench

[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.

https://openbmb.github.io/ToolBench/

Apache License 2.0

4.62k stars 397 forks source link

Open yhyu13 opened 7 months ago

yhyu13 commented 7 months ago

Use transformer implementation of flash attention2