search

google-research / big_vision

Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.
Apache License 2.0
2.3k stars 152 forks source link

Where do I find the new ViT baseline param? #1

Closed sayakpaul closed 2 years ago

sayakpaul commented 2 years ago

Regarding https://github.com/google-research/big_vision#vit-baseline

xiaohuazhai commented 2 years ago

It's available here:

https://github.com/google-research/big_vision/blob/main/big_vision/configs/vit_s16_i1k.py

You can always find all our configs under configs folder.

sayakpaul commented 2 years ago

Sorry, I should have been clearer. By param, I meant the pre-trained params. Are they available yet?

akolesnikoff commented 2 years ago

It is an oversight from our side: we will publish it soon. Leaving the issue open until then.

sayakpaul commented 2 years ago

Thanks!

As soon as they're available I will try to port them to a TensorFlow / Keras friendly model for wider community adoption.

akolesnikoff commented 2 years ago

Models have been landed, see https://github.com/google-research/big_vision/blob/6c376d6f621fe93627ee697674abd202392d8faa/big_vision/models/vit.py#L328

Closing the issue, feel free to reopen if you have any questions.