dllllb / pytorch-lifestream

A library built upon PyTorch for building embeddings on discrete event sequences using self-supervision
Apache License 2.0
220 stars 48 forks source link

Multimodal embedding #127

Open vzapylikhin opened 11 months ago

vzapylikhin commented 11 months ago

Hello! We are writing a master's thesis and our supervisor has provided us with a dataset where there are texts of negotiators (winners and losers), their neurometry (data from an encephalogram) and recognized emotions. He asked us to encode this dataset into multimodal embeddings. And we don't really understand how lifestream can be applied to this? Perhaps someone has a demo version of how to do smth like this or some hints of pleaseee?