Open dreamyou070 opened 1 month ago
The SVD is built with EDM framework, which is a continuous diffusion format. Yet the consistency distillation requires us to set discrete timesteps for distillation. You might refer to https://github.com/luosiallen/latent-consistency-model/blob/main/LCM_Training_Script/consistency_distillation/train_lcm_distill_sd_wds.py if you are building things with DDPM framework.
when you train LCM_svd, you set svd_solver like,
svd_solver = SVDSolver(args.N, noise_scheduler.config.sigma_min, noise_scheduler.config.sigma_max, 7,0.7, 1.6)
why you change training timestep to args.N (for example 40), can I get advice about the SVDSolver ..?