[Bug]: ip-adapter seems not work on text2image, image2image works fine

Checklist

[ ] The issue exists after disabling all extensions
[ ] The issue exists on a clean installation of webui
[ ] The issue is caused by an extension, but I believe it is caused by a bug in the webui
[ ] The issue exists in the current version of the webui
[ ] The issue has not been reported before recently
[ ] The issue has been reported before but has not been fixed yet

What happened?

I try to use ip-adapter face id model to make sure the generated image has the same face as reference image on text2image. The result seems ip-adapter does work take effect at all. image2image works fine though

Steps to reproduce the problem

1 select text2image 2 add ip-adpter from controlnet, and upload reference image, then generate

What should have happened?

face should be the same as reference image

What browsers do you use to access the UI ?

Google Chrome, Microsoft Edge

Sysinfo

Console logs

Additional information

No response

lllyasviel / stable-diffusion-webui-forge

[Bug]: ip-adapter seems not work on text2image, image2image works fine #425