How to load Tensorflow checkpoints?

mx-mark / VideoTransformer-pytorch

PyTorch implementation of a collections of scalable Video Transformer Benchmarks.

272 stars 34 forks source link

How to load Tensorflow checkpoints? #23

Open realgump opened 2 years ago

realgump commented 2 years ago

Hello, thanks for your great work. I have successfully trained the Vivit. However, only several checkpoints are available. In another issue, you have mentioned that the pre-trained models are from the original repo of Google. Could you kindly share the code for conversion or tell the method?

mx-mark commented 2 years ago

@realgump you can check this link https://github.com/rwightman/pytorch-image-models/blob/7430a85d07a7f335e18c2225fda4a5e7b60b995c/timm/models/vision_transformer.py#L52.

asif-hanif commented 1 year ago

Hi @mx-mark Referring to Issue#19, Could you please give link of the github repo which converts JAX .npz file to pytorch compatible .pth/.pt file. Thank you!

mx-mark commented 1 year ago

@asif-hanif You can check this link https://github.com/asyml/vision-transformer-pytorch/blob/2d8828948e7ab122f5db11fd67cb7b46c6bb6823/src/checkpoint.py#L80.