YerevaNN / BARTSmiles

BARTSmiles, generative masked language model for molecular representations
MIT License
31 stars 4 forks source link

Any way to open in Hugging Face Transformers library? #4

Open kosonocky opened 1 year ago

kosonocky commented 1 year ago

Apologies if this is obvious / impossible, but is there any way to open the pre-trained models using the huggingface transformers library? Looking to use this model in a paper but my pipeline is built around huggingface, and not the fairseq format.

Any comments are appreciated!

Clay

gokceuludogan commented 1 year ago

Hi there,

I was able to load the Fairseq checkpoint to HuggingFace's implementation of BartModel, but I couldn't validate its performance yet. Here is the Colab notebook, including the required steps.

It would be great if the authors could check it out and verify/correct it.

Best.