search

naver / biobert-pretrained

BioBERT: a pre-trained biomedical language representation model for biomedical text mining
667 stars 88 forks source link

Is there any plan to upload pretrained weight in a different format? #2

Closed izuna385 closed 5 years ago

izuna385 commented 5 years ago

Thanks for uploading pretrained weight. .ckpt seems to be model from tf. Because I am torch user, so I tried to find how to convert tf weights to torch weight(something like weight for nn.Embedding), but I couldn't find out.

Is there any plan to upload weight in the form of, say, GloVe txt format? Like, one row is consisted from word and weight. image

If this could be done, I would do fine-tuning during training my model, for downstream tasks. Thanks.

jhyuklee commented 5 years ago

For now, we don't have any plans to use different formats for pre-trained weights. But if you are a torch user (pytorch I guess), this closed issue might help: https://github.com/dmis-lab/biobert/issues/2. Thanks.

izuna385 commented 5 years ago

Thanks, I'll try that.