Allow for performers to be used on cpu-only torch

lucidrains / performer-pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

MIT License

1.07k stars 143 forks source link

Allow for performers to be used on cpu-only torch #59

Closed i404788 closed 3 years ago

i404788 commented 3 years ago

This PR resolves an issue I had using the performer on cpu-only torch where it failed to import the missing cuda components.

Tested with pip3 install torch==1.4.0+cpu -f https://download.pytorch.org/whl/torch_stable.html

i404788 commented 3 years ago

I've also added 1.4 as compatible in setup.py since I seem to be able to use it fine. Although I'm not sure if the restriction was set for different reasons.

lucidrains commented 3 years ago

@i404788 sorry, won't be supporting torch 1.4, it's too old!