huggingface / optimum-intel

🤗 Optimum Intel: Accelerate inference with Intel optimization tools
https://huggingface.co/docs/optimum/main/en/intel/index
Apache License 2.0
364 stars 101 forks source link

[OV] Sets symbols on inputs and variables #696

Open jane-intel opened 3 months ago

jane-intel commented 3 months ago

What does this PR do?

OpenVINO exporter sets symbols for model inputs. It helps symbolic propagation and optimizations in OpenVINO.

OpenVINO provides symbolic shape inference and optimizations. By default, they deduce dimension relations from the model structure. However, in some cases it is impossible to deduce dimension relations, therefore user-defined symbols allow for smoother symbol propagation.

Note: this change would only be working starting from 2024.3 OpenVINO release as it relies on new features of OpenVINO PyTorch FrontEnd

Before submitting