search

google-research / scenic

Scenic: A Jax Library for Computer Vision Research and Beyond
Apache License 2.0
3.14k stars 419 forks source link

ViT 22B checkpoint ? #754

Closed jrabary closed 1 year ago

jrabary commented 1 year ago

Hi, Do you plan to release the model and checkpoint of ViT22b presented in "Scaling Vision Transformers to 22 Billion Parameters" ?

MostafaDehghani commented 1 year ago

Thanks @jrabary for the question. Unfortunately, we won't be able to release the ViT-22B checkpoint as it was trained on JFT (Google internal) dataset. We however trying to release the code, but it'll take some time to get all the approvals.

nemonameless commented 10 months ago

hi, when will the codes be released?

nemonameless commented 10 months ago

@MostafaDehghani