ZhangGongjie
commented
2 years ago Thanks for the interest in this work!
The concept of "the same embedding space" comes from Siamese Networks, where two identical and weight-sharing sub-networks project query and key into the same embedding space, thus ensuring better matching between them.
You may refer to papers or blogs about Siamese Networks for more details.
what means “the same embeding space”