Closed Eagle07-Sudo closed 8 months ago
if you need to generate the image without controlnet it's better to use IPAdapter (any FaceID model).
You can send a black image in the image_kps if you really want but you are not taking advantage of InstantID.
Ah, it's good to clarify that, thank you.
But, can you make load InstantID Model
node load the file from the ComfyUI\models\ipadapter\instantid
directory instead of ComfyUI\models\instantid
? This way, it becomes visible to the Load IPAdapter Model
node. Because currently, it is not possible to connect Load InstantID Model
node to the Apply IPAdapter
node.
you can copy the model but that's not how they are meant to be used...
Yes, I make a copy and I get this Error:
Error occurred when executing IPAdapterApply:
Error(s) in loading state_dict for Resampler: size mismatch for proj_in.weight: copying a param with shape torch.Size([1280, 512]) from checkpoint, the shape in current model is torch.Size([1280, 1280]).
yeah like I said... they are not meant to be used that way
Alright, I conducted tests and found it valuable to share a summary as it might be of interest to someone:
In the past, I used to benefit from the feature of separating the main "InstantID" node from the "Face Keypoints Controlnet". So, sometimes I could generate image without a pose reference. However, after the recent modification, the pose has become mandatory, and it is not possible to provide an image without including the pose. So, I hope it is possible to have a way to turn off the pose, such as making the
image_kps
input mandatory for those who want to specify the pose, while theimage
input does not include the pose in any case.