FluxML / GeometricFlux.jl

Geometric Deep Learning for Flux
https://fluxml.ai/GeometricFlux.jl/stable/
MIT License
348 stars 30 forks source link

Adds GATv2 layer #259

Closed abieler closed 2 years ago

abieler commented 2 years ago

IDK if its worth introducing a new abstact type for the two GAT layers as some of the functions are identical.

Could replicate the results from Figure 1 in the paper regarding the attention scores:

GATConv Layer gat-attention-scores

GATv2 Layer gatv2-attention-scores

note the difference is that here we have self-loops required, which results in the 1st alpha score not being 0 for all queries.

yuehhua commented 2 years ago

Would you mind adding some tests?

yuehhua commented 2 years ago

@abieler Thank you for contribution. I will merge this first then fix the tests.