Open SUZILI7 opened 2 months ago
You're basically right.
LPS (patch selection) is for class TokenSparse
https://github.com/CrossmodalGroup/LAPS/blob/main/lib/cross_net.py#L14
SPC (patch calibration/aggregation) is for class TokenAggregation
https://github.com/CrossmodalGroup/LAPS/blob/main/lib/cross_net.py#L61
SPA (patch-word alignment) is for def mask_xattn_one_text
https://github.com/CrossmodalGroup/LAPS/blob/main/lib/cross_net.py#L203
https://github.com/CrossmodalGroup/LAPS/blob/main/lib/xttn.py#L225
非常感谢!
这几个分别对应的是TokenSparse类,TokenAggregation类和CrossSparseAggrNet_v2类吗