dennlinger / summaries

A toolkit for summarization analysis and aspect-based summarizers
MIT License
11 stars 0 forks source link

Select level of duplicate removal #56

Open dennlinger opened 2 years ago

dennlinger commented 2 years ago

We currently already differentiate between different kind of duplicates, and even though I think that all duplication should be eliminated, there are rare instances where, for example, reference duplicates are not necessarily the end of the world. Therefore, it should be possible to select which kinds of duplicates will be eliminated.