theislab / multimil

Multimodal weakly supervised learning to identify disease-specific changes in single-cell atlases
https://multimil.rtfd.io/
BSD 3-Clause "New" or "Revised" License
19 stars 3 forks source link

adding mlp attention mechanism #47

Closed M0hammadL closed 2 years ago

M0hammadL commented 2 years ago

as discussed we have to test attention with mlp + sigmoid as in Ario's paper and formula I sent you

alitinet commented 2 years ago

added in 44312001a790dc0957a241f41694c32d15e12fa5, added more parameters in 8eba3ac5a5e9b4405e86f7dc15fbf89bf35232ed, set scoring='MLP' to test