Add flash attention? - Githubissues

LittleLittleCloud / Torchsharp-phi

Torchsharp port of phi-series model

7 stars 2 forks source link

Open shaltielshmid opened 4 months ago

shaltielshmid commented 4 months ago

This is a fantastic library! Perhaps add in Flash Attention?

Check out the announcement here.

LittleLittleCloud commented 4 months ago

@shaltielshmid Thanks, I'll take a look