Support IPAdapters for FLUX pipelines

[chenxiao111222]

Model/Pipeline/Scheduler description

IPAdapter for FLUX is available now, do you have any plans to add IPAdapter to FLUX pipelines?

Open source status

• [X] The model implementation is available.
• [X] The model weights are available (Only relevant if addition is not a scheduler).

Provide useful links for the implementation

model implementation:

• https://github.com/XLabs-AI/x-flux/blob/main/src/flux/xflux_pipeline.py#L55

model weights:

• https://huggingface.co/XLabs-AI/flux-ip-adapter-v2
• https://huggingface.co/XLabs-AI/flux-ip-adapter

[sayakpaul]

Cc: @asomoza

https://github.com/huggingface/diffusers/pull/9787

[hj13-mtlab]

@sayakpaul flux ip adapter error, 'FluxTransformer2DModel' object has no attribute 'encoder_hid_proj'