-
Hi there, you made fantastic framework for llms. But what I find very confusing is how to run this on cuda and direct ml. I simply don't know how to do it in C#..
I there any example? Second questio…
-
Are there any plans to support DirectML as an alternative to TF?
Have not seen this request in the Issues list.
-
### Checklist
- [ ] The issue exists after disabling all extensions
- [ ] The issue exists on a clean installation of webui
- [X] The issue is caused by an extension, but I believe it is caused by a …
-
### Describe the issue
Using directML to inference accelerate onnxruntime, a crash occurred.
used default onnxruntime options.
with Nvidia 4050.
-->igd12um64xel.dll
-->D3D12Core.dll
-->DirectML.dll
…
-
### Feature description
DirectML (Direct Machine Learning) is a high-performance, hardware-accelerated API that can leverage the capabilities of modern GPUs and TPUs on Windows platforms. Integrati…
-
**Describe the bug**
When using the prebuilt v0.5.0 DirectML ES runtime on Windows 11 using C++, it fails with the error:
```
D3D Error 887e0003: (19196@617069187) at 00007FF89073B23F - Unable to loa…
-
hello,
directml is a machine learning capability on top of directX. with this capability, models can be run on low end gpu devices on windows.
-
### Describe the issue
Hi team,
I am currently running T5-Small model inference using OnnxRuntime. The model I am using to run the inference is - `https://huggingface.co/Xenova/t5-small/tree/main/onn…
-
### Checklist
- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a …
-
Currently the best results we can get with whisper.cpp is with Cuda (Nvidia) or CoreML (macOS).
On Windows there's only OpenBlas and it works slow, maybe 2 times of the duration of the audio (amd r…