search

microsoft / DirectML

DirectML is a high-performance, hardware-accelerated DirectX 12 library for machine learning. DirectML provides GPU acceleration for common machine learning tasks across a broad range of supported hardware and drivers, including all DirectX 12-capable GPUs from vendors such as AMD, Intel, NVIDIA, and Qualcomm.
MIT License
2.15k stars 286 forks source link

ARM64 support for pytorch-directml #366

Open ms300 opened 1 year ago

ms300 commented 1 year ago

Hi, is there any plan with Pytorch-directml for Windows on ARM or ARM64 Linux(WSL 2)?

Only x86/x64 whls on Pypi for now: https://pypi.org/project/torch-directml/#files. And binaries included so i can't compile it by myself.

It is an effective lib for ML on Snapdragon devices and it would be nice to have to develop on Windows DevKit 2023!

Adele101 commented 1 year ago

Thank you for submitting this issue. While I can't provide a timeline for resolution as the moment, please know that your feedback is valuable to us. We will follow up once we can review this issue.

hez2010 commented 3 weeks ago

Is there any update to this issue? I want to use pytorch-directml on Windows arm64 based Copilot+PC.

mcornier commented 6 days ago

+1, Microsoft, you're not ready with Windows 11 on ARM. Why? The Surface Pro X should have opened the path to this kind of support, but it's like it didn't. The result: no DirectML torch for ARM64/AArch64 Windows or WSL2 Linux. No real Qualcomm support, poor SDK... And the x86 versions don't seem to work either.

PC with NPU ? I should stay with a NVidia GPU :(

hez2010 commented 5 days ago

A short update: I've been able to instantiate a DirectML device on Windows 11 on ARM since DirectML 1.15.0. But we still need a pytorch-directml package for Windows ARM64.

joshjkim commented 5 days ago

@hez2010 @mcornier We recently ramped up support for torch-directml and have many new features coming before the year closes. Support for ARM64 is high up in that list :)