search

lalalune / arcprize

34 stars 4 forks source link

xformers / flash attention #11

Closed lalalune closed 1 month ago

lalalune commented 1 month ago

Training is slow. We should do whatever we can to improve memory and training speed.