search

siyuhuang / QuantArt

Official PyTorch implementation of QuantArt (CVPR2023)
MIT License
91 stars 6 forks source link

codebook visualization #4

Open xiaofeixia2022 opened 8 months ago

xiaofeixia2022 commented 8 months ago

Hello, based on the information you provided, I successfully replicated the model, and the results are excellent! In your article, you mentioned the function of the codebook 'to learn to cluster the artwork distribution in the representation space, where the centroids of all clusters form an artwork codebook Zart.' I'm very interested in knowing how to visually demonstrate the clustering effect on the dataset

siyuhuang commented 1 month ago

Hi @xiaofeixia2022, you can use visualization tools like tSNE to plot the codebook distribution. However, we do not include this in our paper, since the visualization results are most likely not interpretable, since each code only refers to a small patch of the original image, and also, it interacts with the neighboring codes.