search

LuckyTiger123 / DropMessage

The implementation for DropMessage.
23 stars 11 forks source link

Consult the details of DropMessage in the code #2

Closed HazeDT closed 1 year ago

HazeDT commented 1 year ago

Appreciate your work.

But when I read the code, I only found DropNode, DropEdge, and Dropout in the layer.DropBlock. Besides, only this part is related to DropMessage. image

May I ask which part of the code DropMessage is in? And how it works in the model?

Grateful.

LuckyTiger123 commented 1 year ago

Only DropMessage assigns message_drop a non-zero value at this step. This parameter will be passed to the backbone model at line 80 of the file src/layer.py. You can see the code with the comment drop messages in the message function of various backbone models in the file src/backbone.py. We implement DropMessage by conducting random dropping in the message function.