search

lucidrains / ring-attention-pytorch

Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
MIT License
474 stars 27 forks source link

8 A100S #2

Closed kyegomez closed 7 months ago

kyegomez commented 8 months ago

Willing to give you 8 A100s for this, lmk through email

lucidrains commented 7 months ago

I went ahead and tested it on a rented machine on runpod. thanks for the offer Kye