Tsingularity / dift

[NeurIPS'23] Emergent Correspondence from Image Diffusion
https://diffusionfeatures.github.io
MIT License
594 stars 32 forks source link

Question about Prompt for stable diffusion to obtain Feature maps #7

Closed IFICL closed 1 year ago

IFICL commented 1 year ago

Thanks authors for the nice work. I have some questions about obtain feature map from stable diffusion model. According to your code, if I read correctly, you will need a text prompt, e.g., " a photo of cat" to obtain the diffusion feature.

I wonder how authors obtain the text prompts when evaluating on the label progation benchmarks or other benchmarks. Do you need to annonate them in a rough way?

Tsingularity commented 1 year ago

Hi, thanks for your interest in our work!

For DIFT_sd, on homography estimation and label propagation tasks, we use null prompt (empty string). See more implementation details in Appendix A of the paper.

IFICL commented 1 year ago

Thanks for the infromation. I will close the issue