Inference speed is too slow, how to optimize it and accelerate inference?

tgxs002 / HPSv2

Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesis

Apache License 2.0

403 stars 12 forks source link

Open SkylerZheng opened 1 year ago

SkylerZheng commented 1 year ago

Hi, I used HPSv2 on A100(1 single GPU), it's about 21-23 seconds per run. Are there anyway we can try to improve the latency?

tgxs002 commented 1 year ago

Do you have a minimal script to reproduce the issue?