openvinotoolkit / openvino

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
https://docs.openvino.ai
Apache License 2.0
6.57k stars 2.12k forks source link

[Good First Issue]: Possible Conditional Compilation Optimization for type_to_fuse_map #23069

Open riverlijunjie opened 5 months ago

riverlijunjie commented 5 months ago

Context

Conditional Compilation is very helpful to optimize openvino binaries size for specified platforms and models, seems it can be used for type_to_fuse_map to do some binaries optimization:

https://github.com/openvinotoolkit/openvino/blob/f9605cd8d4c488ad405397bc4294e35a403ae803/src/common/transformations/src/transformations/convert_precision.cpp#L430-L477

Need to consider usage of CC factory here, because in case of conditional compilation, this map will hold all the operations, which are not even used in the model. See https://github.com/openvinotoolkit/openvino/blob/master/src/common/conditional_compilation/include/openvino/cc/factory.h

What needs to be done?

  1. Apply Conditional Compilation for type_to_fuse_map to optimize binaries size.
  2. Measure how many binaries size benefit can be achieved from this optimization.

Example Pull Requests

No response

Resources

Contact points

@riverlijunjie

Ticket

No response

RamyaKappagantu commented 5 months ago

Hi @riverlijunjie , I would like to work on this task as a part of GSoC pre-requisite. Could you please assign this to me?

p-wysocki commented 4 months ago

Hello @RamyaKappagantu, are you still working on this? Is there anything we could help you with?

MirImaadAli1 commented 3 months ago

.take

github-actions[bot] commented 3 months ago

Thank you for looking into this issue! Please let us know if you have any questions or require any help.

p-wysocki commented 2 months ago

Hello @MirImaadAli1, are you still working on that issue? Do you need any help?