search

SKKU-ESLAB / Auto-Compression

Automatic DNN compression tool with various model compression and neural architecture search techniques
MIT License
20 stars 20 forks source link

[Question] model compression for NLP #51

Open nugabom opened 1 year ago

nugabom commented 1 year ago

your project focus on CNN model compression. but I'm intersted in NLP and other transformer. I have a question that your model compession technique also apply on NLP and other transformer?. if you send message that these of your projects also apply on NLP and other transformer, it is very nice

asdfrv100 commented 1 year ago

we focus model compression for CNN on on-device. but our ADMM , quantization technique also apply NLP and transformer. maybe you have knowledge of NLP and transformer, you can apply our technique