kyegomez / LongNet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
https://discord.gg/qUtxnK2NMf
Apache License 2.0
688 stars 64 forks source link

AMD Support #18

Closed userbox020 closed 1 year ago

userbox020 commented 1 year ago

Hello, How can i use my amd gpu with longnet?

Upvote & Fund

Fund with Polar

kyegomez commented 1 year ago

@userbox020 Hey now there is a device param, look at the pytorch docs and look for AMD gpu device!