G-U-N / Phased-Consistency-Model

Boosting the performance of consistency models with PCM!
https://g-u-n.github.io/projects/pcm/
Apache License 2.0
332 stars 10 forks source link

[Question] What's the motivation behind adversarial loss: ReLU(1 + x) + ReLU(1 - x) #15

Open Luciennnnnnn opened 1 month ago

Luciennnnnnn commented 1 month ago

Hi, what's the motivation behind adversarial loss: ReLU(1 + x) + ReLU(1 - x), is there any reference?

G-U-N commented 1 month ago

This is a typo here, and it should be $\textrm{ReLU}(1 + D (\tilde{x}_s, c, s)) + \textrm{ReLU}(1 - D(\hat{x}_s, c, s))$, where $D$ is the discriminator, $c$ is the text conditions and $s$ is the timestep conditions. The $\textrm {ReLU}$ function is equivalent to normally applied hinge loss.

G-U-N commented 1 month ago

You can refer to this line.

Luciennnnnnn commented 1 month ago

yes, thank you for clarify. What I'm asking is the name/origin of this adversarial loss. So it is hinge loss, got it!