Helper script for adding tags to existing longmbart model - Githubissues

a-rios / longmbart

Apache License 2.0

4 stars 6 forks source link

Helper script for adding tags to existing longmbart model #4

Closed nicolasspring closed 3 years ago

nicolasspring commented 3 years ago

This PR adds a helper script for adding tags to an existing longmbart model.

It it is based on the functionality in convert_mbart_to_longformerencoderdecoder.py with additional features:

Also performing the same operations on the state_dict of model checkpoints.
Overwriting the embedding of an existing tag.
Ensuring the IDs of added tokens are sequential numbers. This allows adding tokens in multiple steps without errors.