jasperzhong / read-papers-and-code

My paper/code reading notes in Chinese
43 stars 3 forks source link

KDD '19 | Representation Learning for Attributed Multiplex Heterogeneous Network #341

Closed jasperzhong closed 1 year ago

jasperzhong commented 1 year ago

https://arxiv.org/pdf/1905.01669.pdf

jasperzhong commented 1 year ago

image

这篇文章考虑的是只有一个node type,但是有多种edge type的异构图,并且node有attributes,称之为Attributed Multiplex Heterogeneous Network (AMHEN). 这种图在推荐系统里面太常见了,比如user-item graph,user item由于是bipartite所以可以看成是一种node type,但是user可以click item, add-to-preference, add-to-chart, conversion...有很多操作,每一种操作都是一个relation.

GATNE其实方法挺直接的,每个node每个edge type做类似于GraphSAGE (mean aggregation)生成一个node embedding,得到m个node embedding(m为edge type数量),然后对这m个node embedding做一个self-attention,得到加权的node embedding,最后加上base embedding.

base embedding是来自于node本身有attribute,可以做一个linear transformation变成base embedding. 另外,node attribute可以做一个linear transformation成为每个edge type的起始node embedding.

所以这么一看,每个node要维护m个node embedding for each edge type.

这里samping方法就是正常的uniform sampling,和GraphSAGE一样,只不过要对每个edge type都做一次sampling.

值得注意的是这里用metapath2vec的random walk方法生成了training samples.