pyg-team / pytorch_geometric

Graph Neural Network Library for PyTorch
https://pyg.org
MIT License
20.54k stars 3.57k forks source link

Implementation of LLM-to-LM GNN #9361

Open rusty1s opened 1 month ago

rusty1s commented 1 month ago

🚀 The feature, motivation and pitch

Paper: Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text Attributed Graph Representation Learning (ICLR 2024)

The paper uses the power of an LLM to get a meaningful explanation, which is then used to fine-tune a smaller LM+GNN. Really interesting paper. Would be great to have an example of it in PyG :)

devanshamin commented 1 month ago

Hi @rusty1s ,

I can work on creating an example implementation of this feature in PyG.

rusty1s commented 3 weeks ago

That would be amazing :)

devanshamin commented 3 weeks ago

PR should be up by end of this week.