google-research / pix2struct

Apache License 2.0
604 stars 54 forks source link

Pre-trained models and inference example? #1

Closed ghost closed 1 year ago

ghost commented 1 year ago

Hi are the pre-trained models released and is there an example for performing inference using the objective used for pre-training.

Thanks!

kentonl commented 1 year ago

Yes, the pretrained models are released and specified in the configs/init config files. For example, the base model is specified at https://github.com/google-research/pix2struct/blob/main/pix2struct/configs/init/pix2struct_base_init.gin.

We just released code for doing standalone inference, and you can do that with the pretrained checkpoints. Please see https://github.com/google-research/pix2struct#inference for instructions.