triton-inference-server / openvino_backend

OpenVINO backend for Triton.
BSD 3-Clause "New" or "Revised" License
30 stars 16 forks source link

Enable iGPU/dGPU plugin of OpenVINO #62

Open AlexKoff88 opened 9 months ago

AlexKoff88 commented 9 months ago

This is a placeholder for the task that will enable usage of Intel GPU in Triton via OpenVINO.

AlexKoff88 commented 9 months ago

@dtrawins, do you have any idea who could complete this task?

dtrawins commented 7 months ago

That effort is in progress now. A draft of the PR is in https://github.com/triton-inference-server/openvino_backend/pull/74