Yasoz / ControlTraj

The implementation of ControlTraj for KDD 2024
13 stars 2 forks source link

Cross-Attention Mechanism #3

Open xiangyundeyun opened 1 month ago

xiangyundeyun commented 1 month ago

In the cross-attention mechanism, when the sequence length of x (denoted as seq_len) and the number of conditional embeddings cond (denoted as n_cond) are different, it is necessary to ensure that the dimensions of q, k, and v are compatible for attention computation