On Graph Neural Networks (GNNs)

[wolfram77]

From Algorithmic Simplicity:

• [x] Why Does Diffusion Work Better than Auto-Regression? - YouTube
• [ ] Transformer Neural Networks Derived from Scratch - YouTube
• [x] Why do Convolutional Neural Networks work so well? - YouTube
• [x] But what is a neural network REALLY? - YouTube

GNN articles:

• [x] 18.Limitations of Graph Neural Networks | machine-learning-with-graphs – Weights & Biases
• [ ] Graph Neural Network Series 5 — The Future of Graph Intelligence: Challenges and Developments in GNN | by Renda Zhang | Medium
• [ ] Issues with graph neural networks: the cracks are where the light shines through | Oxford Protein Informatics Group
• [ ] Graph Neural Network and Some of GNN Applications
• [ ] Classic GNNs are Strong Baselines: Reassessing GNNs for Node Classification

From JNTUH GNN group:

• [ ] Stanford CS224W: Machine Learning with Graphs | 2021 | Lecture 1.1 - Why Graphs - YouTube (Lecture 3 to start)
• [ ] [1706.02216] Inductive Representation Learning on Large Graphs
• [ ] [1706.03762] Attention Is All You Need
• [ ] [1710.10903] Graph Attention Networks

From Artem Kirsanov:

• [x] The Most Important Algorithm in Machine Learning - YouTube
• [x] A Brain-Inspired Algorithm For Memory - YouTube

From Mithin (JNTUH):

• [ ] A Gentle Introduction to Graph Neural Networks
• [ ] Recipe for a General, Powerful, Scalable Graph Transformer
• [ ] Graph attention networks
• [ ] Do transformers really perform badly for graph representation?
• [ ] Neural message passing for quantum chemistry

[wolfram77]

Transformer Neural Networks Derived from Scratch - YouTube

Are there oversmoothing issues in CNNs, similar to GNNs?