search

InfluenceFunctional / MXtalTools

BSD 3-Clause "New" or "Revised" License
8 stars 1 forks source link

Rewrite custom self attention convolution #92

Closed InfluenceFunctional closed 5 months ago

InfluenceFunctional commented 10 months ago

get out of gnn TransformerConv

InfluenceFunctional commented 6 months ago

also - the softmax utility for the attention calculation appears slow and to have superlinear scaling with the batch size