search

quic / aimet-model-zoo

Other
296 stars 53 forks source link

Where is the code for Mobilebert use QAT? #40

Closed wminiboy closed 1 year ago

wminiboy commented 1 year ago

Where is the code for Mobilebert use QAT ? I can't find .

quic-mangal commented 1 year ago

@quic-hanwxion Could you please help answer this. Thanks.

quic-hanwxion commented 1 year ago

Hi @wminiboy , we decided to publish only evaluation pipeline and not the QAT pipeline. If you want to try it on your self, you can follow the AIMET QAT instructions on this page: https://quic.github.io/aimet-pages/releases/latest/api_docs/torch_quantsim.html#code-example-quantization-aware-training-qat:~:text=learned%20during%20training.-,Code%20Example%20%2D%20Quantization%20Aware%20Training%20(QAT),-%C2%B6

wminiboy commented 1 year ago

@quic-hanwxion If it will be released in the future, can you send me the development version now? For learning reference . Thank you
Email:wminiboy@gmail.com

quic-hanwxion commented 1 year ago

Hi @wminiboy , the AIMET version being used in MobileBert is indicated here: https://github.com/quic/aimet-model-zoo/blob/develop/aimet_zoo_torch/mobilebert/MobileBert.md#:~:text=tested%20using%20AIMET%20version%201.27.0%20(i.e.%20set%20release_tag%3D%221.27.0.

By "development version" do you mean the actual QAT script? If so, it's not meant for external release and thus can't be sent. Sorry about that!

wminiboy commented 1 year ago

OK， Thank you.