Filter by exclusion terms

Fundacio-Bit / escolta-activa-rss-news-intranet-deprecated

Intranet to manage news extraction from RSS feeds.

1 stars 1 forks source link

Filter by exclusion terms #52

Closed eaguado closed 3 years ago

eaguado commented 3 years ago

Filter every text field which contain any exclusion terms. An exclusion term can be a word or a strings. Use "lodash deburr" and "toLowerCase" to normalize texts.

eaguado commented 3 years ago

Added dictionary for exclusion terms.
Filtered news by exclusion terms, passing the news that contains any of these terms in any of its texts to the list of discarded news.
Stats counters also filter by exclusion terms.

Front refresh news list, discarded news list and stats when a dictionary or exclusion term is updated.

eaguado commented 3 years ago

TODO:

Reports generation should be changed according this.

eaguado commented 3 years ago

Filtered by strings with more than one word. Applied lodash.deburr and regexp to replace multiple spaces, tabs, newlines, etc with a single space.