htyjers / StrDiffusion

[CVPR 2024] Structure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpainting
Apache License 2.0
85 stars 11 forks source link

condition add #13

Closed maoqiuerer closed 5 months ago

maoqiuerer commented 6 months ago

如果我想添加一个条件特征比如canny、mask和输入一起嵌入进去,我需要修改输入维度和权重吗?

htyjers commented 6 months ago

你可以在这里对输入的维度进行更改,同时,你可以在这里对模型代码进行更改。你需要观察训练过程和结果来判断是否需要改变权重