How to load checkpoint after finetuning?

[anvuongb]

I just completed finetuning process on my own dataset and I'm having problem using the checkpoint file generated by the code.

If I tried to use checkpoints.load() it will throw exception.

If I tried load_pretrained() I don't know how to set the init params.

Am I missing anything?

[andsteing]

Did you have a look at our Colabs

• https://colab.research.google.com/github/google-research/vision_transformer/blob/master/vit_jax.ipynb
• https://colab.research.google.com/github/google-research/vision_transformer/blob/master/vit_jax_augreg.ipynb

You can see example code there how to use checkpoint.load()