-
Hi, please help on aten::softplus.out
The operator 'aten::softplus.out' is not currently supported on the DML backend and will fall back to run on the CPU.The operator 'aten::softplus.out' is not c…
-
**Describe the bug and context**
I'm trying to quantize an optimized Stable Diffusion model.
I got to know that `IncDynamicQuantization` has less reduction in inference speed than `OnnxDynamicQuanti…
-
Thanks for creating this package.
DirectML support would be very useful for AMD card users.
Also, Is there a way to fallback from CUDA/DirectML to CPU using Nuget packages.
Thanks,
Ash
AshD updated
3 months ago
-
### Checklist
- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a …
-
Hi there,
I'm seeking guidance on exporting a custom fine-tuned Phi-3 Vision model to ONNX. I've followed the ONNX build model guide from [this link](https://onnxruntime.ai/docs/genai/howto/build-m…
-
Hello!
I have this code:
```
fn import_model(model_path: &str) -> ort::Session {
INIT.call_once(|| {
ort::init_from("binaries/onnxruntime.dll").commit().unwrap();
});
…
-
The `constant()` operator is special. Constants are effectively inputs that are known at the time of graph compilation (i.e. `build()`).
You may ask, why do we need a separate method when we could…
-
When I try to run the Phi-3-mini-128k-instruct-onnx\cpu_and_mobile\cpu-int4-rtn-block-32-acc-level-4 model with the DirectML package I get this error in generator.ComputeLogits().
Microsoft.ML.OnnxRu…
natke updated
3 months ago
-
I was surprised to learn on the Discord channel that the only GPUs the project supports are Nvidia GPUs (known for being hostile to open source). I have an Intel Arc A750 GPU, which now has full drive…
-
### Checklist
- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a …