Use VQ-VAE model to train a new Structure Aware Language Model

evolutionaryscale / esm

Other

797 stars 81 forks source link

Use VQ-VAE model to train a new Structure Aware Language Model #22

Open Leo-T-Zang opened 4 days ago

Leo-T-Zang commented 4 days ago

Hi ESM3 Team,

Thanks for this amazing work!

I wonder regarding the license, if it is allowed to use your pretrained VQ-VAE model as the tokenizer to train a Structure Aware Language Model (academic purpose).

Thanks!