alibaba / EasyNLP

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit
Apache License 2.0
2.05k stars 252 forks source link

questions about Figure 4 in FPE #353

Closed ArsenLuca closed 7 months ago

ArsenLuca commented 7 months ago

image I've two questions:

  1. Two subfigure (As marked in blue boxes) in Figure 4 seems exactly identical, why it happens
  2. What's the differences in algorithm between "No replacement" and "Direct Generation"

Thanks

Bingyan-Liu commented 7 months ago
  1. They are the same image. To retain the spatial structure between the source and the target image, the upper part of this figure is generated based on replacing the self-attention map in layers 4-14.
  2. In the upper part of Figure 4, "No replacement" indicates that there is no replacement of the cross-attention map from the source image; however, replacement of the self-attention map is included in order to preserve the spatial structure. In the lower part of Figure 4,"No replacement"="Direct Generation".

image I've two questions:

  1. Two subfigure (As marked in blue boxes) in Figure 4 seems exactly identical, why it happens
  2. What's the differences in algorithm between "No replacement" and "Direct Generation"

Thanks