Automatic pipeline assembly crashing on colab

Yale-LILY / SummerTime

An open-source text summarization toolkit for non-experts. EMNLP'2021 Demo

https://arxiv.org/abs/2108.12738

Apache License 2.0

264 stars 30 forks source link

Automatic pipeline assembly crashing on colab #108

Open MuroriM opened 2 years ago

niansong1996 commented 2 years ago

@MuroriM Do you want to self-assign this or you need someone else's help?

MuroriM commented 2 years ago

I'm working on other issues at the moment. If someone else is available to look at it at the moment, that would be helpful.

niansong1996 commented 2 years ago

@MuroriM Can you post a way to replicate the error?

And after that, @zhangir-azerbayev can you take a look and figure out what happens?

MuroriM commented 2 years ago

To replicate the error:

Go to the colab notebook
Run the two cells under ### Using automatic pipeline assembly (the single doc and multi-doc pipeline assembly cells)

They both take a long time and end up using more RAM than allocated on Colab causing the notebook to crash. Using the colab hosted GPU or TPU does not help.