How to convert "bart-large-cnn" to LED version

allenai / PRIMER

The official code for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization

Apache License 2.0

150 stars 31 forks source link

How to convert "bart-large-cnn" to LED version #4

Open TysonYu opened 2 years ago

TysonYu commented 2 years ago

Hi,

Thanks for sharing this great work. I find that you have published the "allenai/led-large-16384" in the Hugging Face "models". I am curious how do you convert the "bart-large" model to "led-large-16384" model. And can you provide the convert scripts? I want to try to convert "bart-large-cnn" to "led-large-cnn-16384"!

Thanks!

Wendy-Xiao commented 2 years ago

Hi there,

Sorry that I don't have the code for conversion of LED model, but you might find conversion in the original LED repo (https://github.com/allenai/longformer).