Add FlexiBERT - Githubissues

huggingface / transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

https://huggingface.co/transformers

Apache License 2.0

128.51k stars 25.49k forks source link

Add FlexiBERT #20362

Open shikhartuli opened 1 year ago

shikhartuli commented 1 year ago

Model description

FlexiBERT is a suite of flexible and heterogeneous models. The design space was proposed in this paper accepted for publication in the Journal of Artificial Intelligence Research.

Open source status

[X] The model implementation is available
[X] The model weights are available

Provide useful links for the implementation

The weights are available here.

shikhartuli commented 1 year ago

The PR was closed by bot. Please reopen the PR and let me know if anything needs to be done to merge the PR. The PR would add the FlexiBERT suite of models to 🤗 Transformers.