Accelerate through onediff - Githubissues

ZHO-ZHO-ZHO / ComfyUI-InstantID

Unofficial implementation of InstantID for ComfyUI

1.32k stars 76 forks source link

Accelerate through onediff #110

Open ccssu opened 7 months ago

ccssu commented 7 months ago

Install OneDiff and its dependencies.

 python3 -m pip install --pre oneflow -f https://oneflow-pro.oss-cn-beijing.aliyuncs.com/branch/community/cu121 && 
git clone https://github.com/siliconflow/onediff.git &&
cd onediff &&
python3 -m pip install -e . &&
cd onediff_diffusers_extensions &&
python3 -m pip install -e .

Accelerate

warmup 2 times
speed:
- baseline: 2.77it/s
- onediff: 5.18it/s
- (5.18 - 2.77) / 2.77 = 0.87 (87% faster)
e2e:
- baseline: 20.18 s
- onediff: 11.88 s
- (20.18 - 11.88) / 20.18 = 0.41 (41% faster)

Add the 📷OneDiff Speed Up node as shown in the following diagram:： workflow (11)

env

NVIDIA A100-PCIE-40GB
torch.version='2.1.2+cu121'
python = 3.10.13
python -m oneflow --doctor version: 0.9.1.dev20240219+cu121 git_commit: 6621521 cmake_build_type: Release rdma: True mlir: True enterprise: False