SKKU-ESLAB / Auto-Compression

Automatic DNN compression tool with various model compression and neural architecture search techniques
MIT License
20 stars 20 forks source link

Hyperparameter auto tuner #6

Closed GH-Jo closed 2 years ago

GH-Jo commented 3 years ago

The compression ratio is determined by two predefined hyperparameters: the method of compression (channel/block-level pruning or quantization) and latency loss alpha.

As of now, we should set these hyperparameters manually depending on our experience.

To produce many different tradeoffs automatically, an automatic hyperparameter selector should be implemented.