GPU support (plans/roadmap)

modularml / mojo

The Mojo Programming Language

https://docs.modular.com/mojo/manual/

Other

23.38k stars 2.6k forks source link

GPU support (plans/roadmap) #3567

Open asmith26 opened 2 months ago

asmith26 commented 2 months ago

Hi there,

I'm thinking about buying a new GPU soon for neural network training/fine-tuning, and was wondering if mojo has plans to support (or currently supports) the various options:

NVIDIA (including e.g. any particular architectures/generations, CUDA versions/CUDA capability)
AMD (including e.g. any particular architectures, ROCm versions)
Intel (including e.g. any particular architectures/generations, oneAPI)

Many thanks for any help! :)

gryznar commented 2 months ago

As far as I know, support for Nvidia GPU is coming with next Max release

ematejska commented 2 months ago

Yes, exactly! Check this out for more info: https://docs.modular.com/max/faq#what-hardware-is-currently-supported-by-max-engine.

asmith26 commented 2 months ago

Thanks that's really helpful. Are there plans to support AMD/Intel GPUs/WebGPU at some point? Thanks again