search

MahmoudWahdan / dialog-nlu

Tensorflow and Keras implementation of the state of the art researches in Dialog System NLU
Apache License 2.0
98 stars 40 forks source link

Support Layer-Pruning #15

Closed MahmoudWahdan closed 4 years ago

MahmoudWahdan commented 4 years ago

Support Layer-Pruning for better training and serving time and performance in production.

[Paper] Poor Man’s BERT: Smaller and Faster Transformer Models https://arxiv.org/abs/2004.03844

MahmoudWahdan commented 4 years ago

First support for some models 397ebbb8ce56c8f3cfd994896b1f0b773dfbc74c