search

microsoft / fastformers

FastFormers - highly efficient transformer models for NLU
Other
700 stars 54 forks source link

Add possibility to fine-tune on other tasks #13

Closed mmuffo94 closed 3 years ago

mmuffo94 commented 3 years ago

🚀 Feature request

Hi, Currently this repo only supports fine-tuning for SuperGlue tasks, am I right? Are you going to enable fine-tuning for other tasks as, for example, a generic sequence classification problem?

Motivation

I believe that fine-tuning on SuperGlue tasks only strongly limits the applicability of Fastformers

ykim362 commented 3 years ago

Thanks for the comment, @mmuffo94! The main purpose of this repository is to demonstrate the models from the FastFormers paper. At the moment, we are not planning to expand the scope.