Could you add support for DirectML?

feiyun0112 / SemanticKernel.Connectors.OnnxRuntimeGenAI

Semantic Kernel connector for ONNX models.

11 stars 4 forks source link

Closed AshD closed 4 months ago

AshD commented 4 months ago

Thanks for creating this package.

DirectML support would be very useful for AMD card users.

Also, Is there a way to fallback from CUDA/DirectML to CPU using Nuget packages.

Thanks, Ash

feiyun0112 commented 4 months ago

have published feiyun0112.SemanticKernel.Connectors.OnnxRuntimeGenAI.DirectML

AshD commented 4 months ago

Thanks @feiyun0112
How do I fallback from DirectML to CPU. Is it automatic?