search

Junyi42 / sd-dino

Official Implementation of paper "A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondence"
https://sd-complements-dino.github.io
271 stars 14 forks source link

Object Swapping (with refinement process) #4

Closed StellarCheng closed 1 month ago

StellarCheng commented 1 year ago

Hi Junyi, Could you please provide the code for Object Swapping (with refinement process), current object swapping result seems blur

Junyi42 commented 1 year ago

Hi,

Thank you for your interest in our work. We are in the process of finalizing the refinement implementation and will release it soon. We appreciate your patience.

In the meantime, you can also refer to this repo: DiffSketch, which implements image-to-image translation with SD features in the similar style of our refinement process. Specifically, you can start with either pnp_sketch.py or pnp_sketch.ipynb and take the preliminary swapped image as input. Plus, you may also need to modify the prompt in pnp_refine_all.yaml to "a photo of a {category_of_instance}, realistic, high resolution, high quality".

I hope this guidance assists you.

Best regards.

StellarCheng commented 1 year ago

Hi,

Thank you for your interest in our work. We are in the process of finalizing the refinement implementation and will release it soon. We appreciate your patience.

In the meantime, you can also refer to this repo: DiffSketch, which implements image-to-image translation with SD features in the similar style of our refinement process. Specifically, you can start with either pnp_sketch.py or pnp_sketch.ipynb and take the preliminary swapped image as input. Plus, you may also need to modify the prompt in pnp_refine_all.yaml to "a photo of a {category_of_instance}, realistic, high resolution, high quality".

I hope this guidance assists you.

Best regards.

Thanks for your reply