Dinov2 HF based notebooks with multi scale and Mask2former

NielsRogge / Transformers-Tutorials

This repository contains demos I made with the Transformers library by HuggingFace.

MIT License

8.42k stars 1.32k forks source link

Open ayushnangia opened 1 week ago

ayushnangia commented 1 week ago

Hi,

Great notebook but does anyone know how to work with multi scale and mask2former with dinov2 and how use dino with registers?

NielsRogge commented 2 hours ago

Hi,

DINOv2 with registers isn't supported yet in the Transformers library, see https://github.com/huggingface/transformers/issues/27379.
Mask2Former suppors loading DINOv2 as backbone, including with pre-trained weights. Could you clarify multi-scale?