huggingface / transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

https://huggingface.co/transformers

Apache License 2.0

131.63k stars 26.2k forks source link

Open jyotsna2893 opened 3 years ago

jyotsna2893 commented 3 years ago

🌟 New model addition

Not completed yet. I will notify very soon when it is done. If anyone has any leads regarding the same issue, please share. It would be great help.

NielsRogge commented 3 years ago

Can you provide a link to a paper, implementation and optional weights, if possible?

jyotsna2893 commented 3 years ago

Hello NeilsRogge, I am building the model on basis of DistilBERT. I am still in the initial phase, but if you want to read/know more about it please go through this link https://huggingface.co/transformers/_modules/transformers/models/distilbert/modeling_tf_distilbert.html#TFDistilBertModel