How to train my own model with other checkpoints?

allenai / specter

SPECTER: Document-level Representation Learning using Citation-informed Transformers

Apache License 2.0

516 stars 56 forks source link

How to train my own model with other checkpoints? #33

Open ryangawei opened 3 years ago

ryangawei commented 3 years ago

Hi,

First, thank you for the excellent work.

I want to train my own model with the SPECTER's objective, e.g. starting with huggingface's bert-base-uncased instead of SciBERT. If possible, what should I do?

Thanks!