search

coolirisme / autosummarizer

MIT License
19 stars 0 forks source link

Filter out Reuters.com promotional text #2

Open Avamander opened 2 years ago

Avamander commented 2 years ago

The bot accidentally includes sentences like "Register now for FREE unlimited access to Reuters.com" in its summaries, it would be nice if those would be filtered out.

pescepalla commented 1 year ago

Consistently getting messages like these instead of the article content:

We process your data to deliver content or advertisements and measure the delivery of such content or advertisements to extract insights about our website. We share this information with our partners on the basis of consent and legitimate interest. You may exercise your right to consent or object to a legitimate interest, based on a specific purpose below or at a partner level in the link under each purpose.

See: https://www.reddit.com/r/anime_titties/comments/y37rd7/comment/is71z1j/?utm_source=share&utm_medium=web2x&context=3

csehszlovakze commented 1 year ago

It also can't get through FT paywalls. see https://www.reddit.com/r/anime_titties/comments/yxhqyp/comment/iwoslmj/?utm_source=reddit&utm_medium=web2x&context=3

A possible workaround could be to route it through archive.today which can remove most paywalls.