Are there plans to add support for dynamic models to Intel gpu plugins?

openvinotoolkit / openvino

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

https://docs.openvino.ai

Apache License 2.0

6.5k stars 2.11k forks source link

Are there plans to add support for dynamic models to Intel gpu plugins? #13498

Closed kc-w closed 1 year ago

ilyachur commented 1 year ago

Yes we have a plan to do it. @vladimir-paramuzov @jane-intel FYI

Ref. CVS-74669

akladiev commented 1 year ago

This issue will be closed in 2 weeks in case of no activity.

avitial commented 1 year ago

New and Changed in 2023.0. Initial support for dynamic shapes on GPU - you no longer need to change to static shapes when leveraging the GPU which is especially important for NLP models. Dynamic shapes are now supported for GPU inference. This means that Natural Language Processing models now work on all the iGPU and dGPU platforms. More models will be supported in the future OpenVINO releases.

For this and more information on 2023.0 release, check the release notes.