Closed angysaravia closed 4 years ago
TinyBERT — Size does matter, but how you train it can be more important https://medium.com/swlh/tinybert-size-does-matter-but-how-you-train-it-can-be-more-important-a5834831fa7d Author: Viktor Karlsson NB> @Data Augmentation section - needs special spacing for >Any data that tells us something about the teachers decision process is useful for distilling its knowledge.
TinyBERT — Size does matter, but how you train it can be more important https://medium.com/swlh/tinybert-size-does-matter-but-how-you-train-it-can-be-more-important-a5834831fa7d Author: Viktor Karlsson NB> @Data Augmentation section - needs special spacing for >Any data that tells us something about the teachers decision process is useful for distilling its knowledge.