TensorStack-AI / OnnxStack

C# Stable Diffusion using ONNX Runtime
Apache License 2.0
221 stars 33 forks source link

StableVideoDiffusion model converter #137

Open saddam213 opened 7 months ago

saddam213 commented 7 months ago

Convert stable-video-diffusion-img2vid-xt to ONNX Olive format

Modules:

saddam213 commented 7 months ago

UNET conversion succeeds, however produces and error on the inference run

Error Log:

[2024-04-20 15:12:03,805] [DEBUG] [ort_inference.py:111:get_ort_inference_session] Normalized providers: ['DmlExecutionProvider'], provider_options: [{}]
2024-04-20 15:12:16.4887444 [E:onnxruntime:, sequential_executor.cc:514 onnxruntime::ExecuteKernel] Non-zero status code returned while running MatMul node. Name:'/down_blocks.0/attentions.0/transformer_blocks.0/attn1/MatMul' Status Message: D:\a\_work\1\s\onnxruntime\core\providers\dml\DmlExecutionProvider\src\MLOperatorAuthorImpl.cpp(2482)\onnxruntime_pybind11_state.pyd!00007FFB90D1EA8F: (caller: 00007FFB90D20241) Exception(3) tid(b2fc) 80070057 The parameter is incorrect.

Unable to find root cause :/