search

learn2phoenix / CSD

MIT License
105 stars 7 forks source link

Code to compute similarity score for any generated image #5

Closed k8xu closed 2 months ago

k8xu commented 5 months ago

I'm interested in trying CSD for computing similarity score against any given generation, as mentioned in the pending items. When will this code be released? Thank you!

somepago commented 5 months ago

Hi. I'm quite busy with a few deadlines right now and I cannot promise the release before the end of June'24.

If you need this right now, it is very easy to compute. First, collect a few paintings from the artist in question. Compute the image embeddings using CSD and average it to get the proto representation. Then generate a few images using a diffusion model with the artist's name in the prompt. Do the same procedure as above and compute the average embedding for these generated images.

Then compute the dot-product similarity between these 2 vectors. Check out Figure 2/section 2 to get a sense of what different similarities might mean.

WangWenhao0716 commented 5 months ago

I came across this repository and found this work really interesting, impressive, and awesome. By the way, I want to promote our works on the style descriptor here:

This repository (https://github.com/WangWenhao0716/AnyPatternStyle) seems provide an easy-to-implement style extractor for artworks.

haofanwang commented 4 months ago

I came across this repository and found this work really interesting, impressive, and awesome. By the way, I want to promote our works on the style descriptor here:

This repository (https://github.com/WangWenhao0716/AnyPatternStyle) seems provide an easy-to-implement style extractor for artworks.

The result is not satisfied in comparison with CSD. I evaluated on several image set with or without same style.

WangWenhao0716 commented 4 months ago

Thanks, I agree that. My work is designed for Image Copy Detection tasks, and the style descriptor is just a generalized application. It is reasonable that it performs worse than the specialized style descriptor CSD. Thanks for your interest again.

learn2phoenix commented 2 months ago

@k8xu Do you still need this, or were you able to solve this? I would like to close this issue

learn2phoenix commented 2 months ago

Closing this due to inactivity. Re-open if required.