[feature request] Support AutoMC in Katib

[gaocegege]

AutoMC (Automatic Model Compression) is yet another tech about AutoML. Here are some references:

• AMC: AutoML for Model Compressionand Acceleration on Mobile Devices
• PocketFlow: An Automated Framework forCompressing and Accelerating Deep Neural Networks [code]

The problem of AutoMC is similar to NAS. Maybe we could implement it after we support NAS.

[andreyvelich]

@gaocegege Is the main idea for AutoMC is to find neural network architecture ?

[gaocegege]

@andreyvelich Similar to NAS while not the same. It is to compress the network to achieve lower latency. It is mainly for mobile devices.

[andreyvelich]

We need to think, is it possible to send all necessary information inside NasConfig for AutoMC.

[gaocegege]

@andreyvelich Sure. Actually, I think the IR we defined for NAS in CRD is insufficiently expressive. Ref https://github.com/kubeflow/katib/issues/461

As for Automatic Model Compression, I think we could reuse the architecture if the IR is expressive. We can refer to the implementation here. https://github.com/Tencent/PocketFlow

[gaocegege]

https://github.com/microsoft/nni/blob/master/docs/en_US/Compressor/Overview.md

Maybe it is helpful.

[issue-label-bot[bot]]

Issue-Label Bot is automatically applying the labels:

Label	Probability
area/katib	0.81

Please mark this comment with :thumbsup: or :thumbsdown: to give our bot feedback! Links: app homepage, dashboard and code for this bot.

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[andreyvelich]

/lifecycle frozen