ecprice / newsdiffs

Automatic scraper that tracks changes in news articles over time.
Other
494 stars 135 forks source link

disambuguate URLs #34

Open amandabee opened 9 years ago

amandabee commented 9 years ago

Saw a tweet about this article http://mobile.nytimes.com/2015/08/14/us/politics/joe-biden-on-beach-vacation-wades-further-into-16-bid.html?referrer=&_r=0 but Newsdiffs doesn't know anything about it. Because I'm clever, I tried this instead: http://www.nytimes.com/2015/08/14/us/politics/joe-biden-on-beach-vacation-wades-further-into-16-bid.html, which worked.

But .. the system should be smarter about suggesting similar URLs, no?