Open mike-shvets opened 5 years ago
Core code is in attention.py. Config is updated with ATTENTION_ENABLED, ATTENTION_COMBINATION_MODE, and ATTENTION_NORMALIZE_MODE. TDID class is updated to optionally include attention.
Core code is in attention.py. Config is updated with ATTENTION_ENABLED, ATTENTION_COMBINATION_MODE, and ATTENTION_NORMALIZE_MODE. TDID class is updated to optionally include attention.