search

facebookresearch / dinov2

PyTorch code and models for the DINOv2 self-supervised learning method.
Apache License 2.0
8.82k stars 766 forks source link

Question About Reproducing LOST Evaluation Metrics for Registers Paper #381

Open katieluo88 opened 6 months ago

katieluo88 commented 6 months ago

Hi! Thank you for the amazing work with including registers and including their checkpoints. I was trying to reproduce the results from Table 3 in "Vision Transformers Need Registers" paper: LOST unsupervised object discovery using the features of the ViT. For some reason, I'm unable to reproduce the number for DINOv2+reg on any of the datasets. We get ~35.94 for the VOC12 dataset, and ~23.39 for the COCO dataset using the official LOST implementation and the official checkpoints of DINOv2+reg (from this github codebase).

We suspect it may be due to the distillation process; is there some way that the authors can confirm this is the case? Can they possibly share the evaluation setting for the results on LOST object discovery?

Many thanks!

nguyenthekhoig7 commented 4 months ago

Hi, same issue here, I ran on LOST, and seem there is no difference between DINOv2 and DINOv2+reg. Wondering what should I change to reproduce.

sceddd commented 4 months ago

The same here, Are there any paper around this topic that I can take a look?