[request] Additional architectures for distilled models

facebookresearch / dinov2

PyTorch code and models for the DINOv2 self-supervised learning method.

Apache License 2.0

8.79k stars 763 forks source link

Open patricklabatut opened 1 year ago

patricklabatut commented 1 year ago

Related issues:

JBartholomewMN commented 2 months ago

Is this still open for consideration? It would be great to know.

Even the smallest model, ViT-S, is pretty heavy in inference cost for some applications and it would be great to have smaller options.