Kinyugo / consistency_models

A mini-library for training consistency models.
https://arxiv.org/abs/2303.01469
MIT License
189 stars 20 forks source link

Pseudo Huber Loss #10

Closed hao-pt closed 6 months ago

hao-pt commented 6 months ago

Could you share some insights into why you use a fixed coefficient c like this: c = 0.00054 * math.sqrt(math.prod(input.shape[1:])) rather than a specific user's defined value like 0.001 in the paper.

Kinyugo commented 6 months ago

I obtained that specific scaling from table 1.

hao-pt commented 6 months ago

Thank you, I just found that in the paper.