google-research / bigbird

Transformers for Longer Sequences
https://arxiv.org/abs/2007.14062
Apache License 2.0
563 stars 101 forks source link

Couldn't able to save and load the model after finetuning #10

Open Maria-philna opened 3 years ago

Maria-philna commented 3 years ago

In bigbird summarization, I have loaded pretrained model , after that I have performed finetuning on gigaword tensorflow dataset , then I tried to save the model using tf.saved_model.save(model, data_dir=export_dir) and loaded the model using loaded_model = tf.keras.models.load_model("/drive/My Drive/Checkpoint_Summarization/original_saved") and it is throwing ValueError: Found zero restored functions for caller function.

Anhar2 commented 3 years ago

Hi, I'm trying to fine-tune it as well, and I encountered your issue by chance, could you solve it though?