search

facebookresearch / xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.
https://facebookresearch.github.io/xformers/
Other
8k stars 564 forks source link

Does xformer require CUDA or can it also be run on TPU/Tranium instances? #993

Closed TommasoBendinelli closed 4 months ago

TommasoBendinelli commented 4 months ago

❓ Questions and Help

The titles sums it all, do I need a CUDA device or is Xformers compatible with other devices?

danthe3rd commented 4 months ago

Hi, xFormers supports only CUDA at the moment, but we have experimental (and limited) support for AMD. There is nothing planned for TPU or Trainium