Actually,this is not an issue,this is a suggestion.
One month ago,PyTorch released their new version:PyTorch 2.1.There are many changes,the change I'm most concerned about is mps backend.
mps device enables high-performance training on GPU for MacOS devices with Metal programming framework. It introduces a new device to map Machine Learning computational graphs and primitives on highly efficient Metal Performance Shaders Graph framework and tuned kernels provided by Metal Performance Shaders framework respectively.
https://pytorch.org/docs/stable/notes/mps.html
Can you add mps device inference?
Sorry,I know it's hard,but I NEED it.
Actually,this is not an issue,this is a suggestion. One month ago,PyTorch released their new version:PyTorch 2.1.There are many changes,the change I'm most concerned about is mps backend. mps device enables high-performance training on GPU for MacOS devices with Metal programming framework. It introduces a new device to map Machine Learning computational graphs and primitives on highly efficient Metal Performance Shaders Graph framework and tuned kernels provided by Metal Performance Shaders framework respectively. https://pytorch.org/docs/stable/notes/mps.html Can you add mps device inference? Sorry,I know it's hard,but I NEED it.