Anonyfox / meteor-scrape

Scrape any Website or RSS/Atom-Feed with ease.
GNU Lesser General Public License v3.0
71 stars 19 forks source link

Fulltext summarization #11

Open Anonyfox opened 9 years ago

Anonyfox commented 9 years ago

Sometimes the "summary" property of articles is just garbage. After a more precise fulltext is achieved through #10 , use algorithms like node-nlpsum to generate a good snippet consisting of a few important sentences.

Whenever a good enough fulltext-length is given, this way should be used instead of relying on meta-properties like open graph stuff.