Open ankitm3k opened 2 months ago
This PR adds new options to enable devices during inference runtime for machines having a iGPU (GPU.0) and dGPU (GPU.1)
We are now able to run inference with device_type as AUTO:GPU.1,CPU and further more combinations
Please close this PR if it is not rejected
Please rebase the branch .... the PR shows multiple commits which are not part of the fix
Rebased the changes
Description
This PR adds new options to enable devices during inference runtime for machines having a iGPU (GPU.0) and dGPU (GPU.1)
Motivation and Context
We are now able to run inference with device_type as AUTO:GPU.1,CPU and further more combinations