search

google-research / tapas

End-to-end neural table-text understanding models.
Apache License 2.0
1.15k stars 217 forks source link

Distilling TAPAS #24

Closed mdmustafizurrahman closed 4 years ago

mdmustafizurrahman commented 4 years ago

Can you share how to obtain a distilled version of TAPAS? There are a lot of papers (https://arxiv.org/abs/1903.12136) out there to obtain a distilled version of BERT.

muelletm commented 4 years ago

Sorry, we haven't looked into distillation so far, but we would guess that the standard recipes would still apply.