Incorporate `newspaper` library

dmarx / twitterMonitor

Simple twitter event detection tool

1 stars 0 forks source link

Incorporate `newspaper` library #35

Open dmarx opened 7 years ago

dmarx commented 7 years ago

Article publication date (to supplement/replace tweet first_occurrence)
Article keywords
Article summary
Article top image

.. This library looks awesome.

https://github.com/codelucas/newspaper

dmarx commented 7 years ago

NB: Library doesn't seem to know how to parse tweets. Need to roll own keyword extraction/summarizer for tweets. May as well use bespoke solution for all articles. Can still use newpaper for text extraction from articles, twython for text extraction from tweets.