Question about the learnable queries in DiffEditor

MC-E / DragonDiffusion

ICLR 2024 (Spotlight)

Apache License 2.0

718 stars 22 forks source link

Question about the learnable queries in DiffEditor #24

Open cuixing100876 opened 6 months ago

cuixing100876 commented 6 months ago

Hi. It seems that the learnable query in the code is randomly initialized. (src/unet/attention_processor.py class Resampler line 321). Besides, there does not appear to be any other initialization of the embedding. However, it is named as ''learnable queries'' in the published paper, which makes me confused.

MC-E commented 6 months ago

Hi @cuixing100876, it is learnable and participates training process.