search

ggerganov / ggml

Tensor library for machine learning
MIT License
10.3k stars 947 forks source link

DirectML support #406

Open brightening-eyes opened 11 months ago

brightening-eyes commented 11 months ago

hello, directml is a machine learning capability on top of directX. with this capability, models can be run on low end gpu devices on windows.

LoganDark commented 11 months ago

models can be run on low end gpu devices on windows

Both CLBlast and OpenBLAS provide this capability. What makes DirectML special?

brightening-eyes commented 11 months ago

the reason is that windows natively supports it. just windows sdk (alongside directX) will suffice then to compile it.

shijunz commented 11 months ago

models can be run on low end gpu devices on windows

Both CLBlast and OpenBLAS provide this capability. What makes DirectML special?

I want to know whether the windows on arm64 is supported? how to check it?

brightening-eyes commented 11 months ago

as far as I know, yes its supported. check this out. this tells that version 1.5 of directml supports it. also, its natively available on directX, meaning no openCL requirement on windows.

shadowndacorner commented 2 months ago

The main benefit of supporting DirectML imo would be support for UWP and Xbox, which afaik don't support any of the other currently implemented backends. Definitely understand that not being a priority, but it would be concretely beneficial for those platforms.