mhamilton723 / FeatUp

Official code for "FeatUp: A Model-Agnostic Frameworkfor Features at Any Resolution" ICLR 2024
MIT License
1.34k stars 79 forks source link

Same object and scene, different Upsampling and Dinov2 features colors #65

Open RoyAmoyal opened 3 months ago

RoyAmoyal commented 3 months ago

Hey, I am trying to get the Dino features for an object using your interesting upsampling method. When I run my custom code of Dinov2, I get the expected result (low resolution, without your upsampling).

But when using your model from the hub, I get different "colors" for the same object and I don't know what the problem is because you didn't release the full code.

Even if I mask the object to remove the background before your PCA, it doesn't help. The semantics of the beer make sense but again the colors are different. For example: the cap of the bottle has a different color than the rest of the bottle, but the color of the cap between different photos is different.

Example without masking: (light blue and strong blue for the same beer) image

Any idea how to fix that?

Thanks for the great work!