Closed Coerulatus closed 3 months ago
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 97.37%. Comparing base (
2267768
) to head (d702faf
).
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
Hello, @levtelyatnikov and I made some changes to allset_transformer_layer. We noticed that the old implementation required a lot of memory when calculating the attention scores when dealing with large graphs. Now the layer achieves the same results with less memory requirements. We also introduced a LeakyReLU activation when calculating the attention as per the official code implementation (lines 168-177). Thank you very much.