Closed JeremyCJM closed 1 year ago
Hi, xf_proj
is an overall semantic feature to represent the given language description. I think it's a common choice in NLP and Motion Generation that use the last token to represent the overall characteristics. This is also used in GLIDE, a typical text-to-image generative model.
Got it, thanks for your reply!
Hi Mingyuan,
I am wondering what is "xf_proj" for in https://github.com/mingyuan-zhang/MotionDiffuse/blob/main/text2motion/models/transformer.py#L394.
Why do you select the word with the maximum embedding value?
Thanks, Jeremy