dmmiller612 / bert-extractive-summarizer

Easy to use extractive text summarization with BERT
MIT License
1.37k stars 307 forks source link

Process only unique text #144

Open m0baxter opened 1 year ago

m0baxter commented 1 year ago

Make sure that only unique text is passed to the clustering algorithm. This helps to avoid ConvergenceWarning and makes sure that the summary does not repeat sentences.