jalammar / ecco

Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
https://ecco.readthedocs.io
BSD 3-Clause "New" or "Revised" License
1.96k stars 167 forks source link

How to serialize the LMOutput object? #109

Open JamesCao2048 opened 8 months ago

JamesCao2048 commented 8 months ago

Hi, I am wondering how to serialize the LMOutput results for later usage? I think it would be usefule when I want to explain the results of the whole dataset and visualize them later. I have tried pickle.dump but meet this error "AttributeError: Can't pickle local object 'add_hook_to_module..new_forward'".

Thanks a lot!