gusye1234 / LightGCN-PyTorch

The PyTorch implementation of LightGCN
870 stars 229 forks source link

Hi! Can I use word embeddings for pretrained user&item weight? #25

Open PeaXCD opened 2 years ago

PeaXCD commented 2 years ago

I notice that the embedding_user and embeddingitem are initialized by torch.nn.init.normal, and there is a choice that whether we use pretrained weight or not. In my dataset, the recommendation results are strongly correlated with the item names. And I want to use BERT to get word embeddings so that similar item names have similar embedding vectors. So can I use word embeddings for pretrained user&item weight to get better performance?

GabyUSTC commented 2 years ago

We didn't try since we don't have this kind of datasets, but I think your idea is reasonable.