dennlinger / summaries

A toolkit for summarization analysis and aspect-based summarizers
MIT License
11 stars 0 forks source link

Allow for custom filter functions added to pipeline #46

Open dennlinger opened 1 year ago

dennlinger commented 1 year ago

This could be an entire list of functions that users may want to define based on custom insights on their dataset. For example, for MassiveSumm, a large portion of the first samples are always the same, and have a shared prefix, but with different other texts.

This could be a nice addition to Analyzer or Cleaner, I probably will try and get this in Cleaner first.