shenweichen / DeepMatch

A deep matching model library for recommendations & advertising. It's easy to train models and to export representation vectors which can be used for ANN search.
https://deepmatch.readthedocs.io/en/latest/
Apache License 2.0
2.19k stars 525 forks source link

Question about Dynamic Routing in MIND model #75

Closed Elvenson closed 2 years ago

Elvenson commented 2 years ago

Hi, I would like to ask about the dynamic routing implementation in the MIND model (this logic). According to the paper, the routing logit bij will get initialised for every batch training/inference. But in the code, I only saw it got initialised in the build() phase, which means it only initialised once. Below is an image that illustrates the MIND routing logit, and here is the link to the paper (link). Looking forward to hearing from you soon, thank you in advance!

Screenshot 2022-06-09 at 6 43 26 PM