evolutionaryscale / esm

Other
1.17k stars 128 forks source link

multimodal representation #23

Closed LDAIprotein closed 2 months ago

LDAIprotein commented 3 months ago

This is a good work I want to know if I can get the embedding of sequence, structure or function by inputting a sequence (without mask) and structure. Is it possible to get multimodal representation?

santiag0m commented 2 months ago

Check https://github.com/evolutionaryscale/esm/issues/2

The model will output embeddings for all tracks, so your use case should work