Capsule Graph Neural Network

[gear]

Abstract: The high-quality node embeddings learned from the Graph Neural Networks (GNNs) have been applied to a wide range of node-based applications and some of them have achieved state-of-the-art (SOTA) performance. However, when applying node embeddings learned from GNNs to generate graph embeddings, the scalar node representations may not suffice to preserve the node/graph properties efficiently, resulting in sub-optimal graph embeddings. Inspired by the Capsule Neural Network (CapsNet) (Sabour et al., 2017), we propose the Capsule Graph Neural Network (CapsGNN), which adopts the concept of capsules to address the weakness in existing GNN-based graph embeddings algorithms. By extracting node features in the form of capsules, routing mechanism can be utilized to capture important information at the graph level. As a result, our model generates multiple embeddings for each graph to capture graph properties from different aspects. The attention module incorporated in CapsGNN is used to tackle graphs with various sizes which also enables the model to focus on critical parts of the graphs.

Our extensive evaluations with 10 graph-structured datasets demonstrate that CapsGNN has a powerful mechanism that operates to capture macroscopic properties of the whole graph by data-driven. It outperforms other SOTA techniques on several graph classification tasks, by virtue of the new instrument.

[gear]

Venue: ICLR 2019 Summary: Proposes a new GCN architecture based on capsule net by Hinton's group.

My opinion: The model might be too complicated while achieving inconsistent minor improvements.

Links Openreview: https://openreview.net/forum?id=Byl8BnRcYm GitHub: https://github.com/benedekrozemberczki/CapsGNN

[gear]

bibtex

@article{
  xinyicapsule2019,
  title="{Capsule Graph Neural Network}",
  author={Xinyi, Zhang and Chen, Lihui},
  journal={International Conference on Learning Representations},
  year={2019},
  url={https://openreview.net/forum?id=Byl8BnRcYm},
}