search

siliconflow / onediff

OneDiff: An out-of-the-box acceleration library for diffusion models.
https://github.com/siliconflow/onediff/wiki
Apache License 2.0
1.4k stars 85 forks source link

It's weird if both instant_id and ip_adapter are enabled in comfyui #970

Open Remember2015 opened 1 week ago

Remember2015 commented 1 week ago

Describe the bug

Only InstantID

img_v3_02c2_ca543abf-64f0-48b5-b3d3-375178f9185g

Only IPAdapter

img_v3_02c2_138273e7-d112-4928-b80a-41c58406286g

Both

img_v3_02c2_461958be-809a-4992-82b6-674c56167f3g The image is blurry and the girl looks like fake ones

Both with onediff disabled

image

Your environment

OS

OneDiff git commit id

OneFlow version info

Run python -m oneflow --doctor and paste it here.

libibverbs not available, ibv_fork_init skipped
path: ['/root/test/venv/lib/python3.11/site-packages/oneflow']
version: 0.9.1.dev20240616+cu121
git_commit: ec7b682
cmake_build_type: Release
rdma: True
mlir: True
enterprise: False

How To Reproduce

Steps to reproduce the behavior(code or script): download sample json from onediff then:

  1. load model by onediff
  2. load controlnet - canny
  3. enable InstantID
  4. enable IPAdapter Advanced (params: linear, average, V Only)
  5. set IPAdapter Model: plus(high strength)

The complete error message

Additional context

Add any other context about the problem here.