About width of the VIT-G model

mlfoundations / open_clip

An open source implementation of CLIP.

Other

9.93k stars 959 forks source link

About width of the VIT-G model #802

Closed OliverHuang1220 closed 8 months ago

OliverHuang1220 commented 8 months ago

Thanks for the excellent work, I have a question about the paper. For the width of the VIT-G model is 1664, may I ask whether this 1664 is calculated by the power-law mentioned in the paper：）

rwightman commented 8 months ago

@OliverHuang1220 page 7 of https://arxiv.org/abs/2106.04560 ... ViT-G model sizing was defined by Google not us....