search

Scalsol / mega.pytorch

Memory Enhanced Global-Local Aggregation for Video Object Detection, CVPR2020
Other
570 stars 116 forks source link

whats the parameter 'us' mean? #33

Closed JTRNEO closed 4 years ago

JTRNEO commented 4 years ago

HI , When I read the code, the MEGA code has a parameter 'us' in its attention module.This is different from that in the Relation Networks for Object Detection paper. What is the meaning of the this parameter? https://github.com/Scalsol/mega.pytorch/blob/a47df6d5af731eeb690756768f834738e93f504a/mega_core/modeling/roi_heads/box_head/roi_box_feature_extractors.py#L522

Scalsol commented 4 years ago

This is a parameter given in Transformer-XL paper, you could find the original meaning there in Section 3.3. I add it just want to see whether this parameter introduced in that paper helpful but its effect is negligible here... Simply deleting it should also work fine.