search

mindspore-lab / mindone

one for all, Optimal generator with No Exception
https://mindspore-lab.github.io/mindone/
Apache License 2.0
335 stars 63 forks source link

sdv2: Parallel for text_to_image #318

Closed Songyuanwei closed 5 months ago

Songyuanwei commented 5 months ago

Parallel can be use for mutil prompts

SamitHuang commented 5 months ago

How is the parallel inference performance?

Songyuanwei commented 5 months ago

How is the parallel inference performance?

tested on sd1.5, chinese_art_blip dataset(20 prompts), n_sample=4, n_iter=2, single card and 8-card inference performance are the same.

For 8-card inference, each card is independent. chinese_art_blip dataset(20 prompts), 0 card inference for the first, 9th, and 17th prompts, 1 card inference for the second, 10th and 18th prompts, ....., 5 card inference for the 6th and 14th prompts, .......

zhtmike commented 5 months ago

how to start the parallel inference, better to write an instruction

Songyuanwei commented 5 months ago

how to start the parallel inference, better to write an instruction

done. It has already been added to readme.