michardy / sources-bot

Bot that identifies other sources of news for a story.
0 stars 0 forks source link

I cannot for the life of me understand these matches #3

Closed michardy closed 7 years ago

michardy commented 7 years ago

Trump has 'inside information' on who protested in Charlottesville, says Falwell Jr. in president's defense Other sources for this story:

  1. Kasich downplays notion of 2020 challenge to Trump, saying president can learn from challenges
  2. Mark Lilla says an obsession with identity politics has wrecked US liberalism
michardy commented 7 years ago

Trump has 'inside information' on who protested in Charlottesville, says Falwell Jr. in president's defense Other sources for this story:

  1. Kasich downplays notion of 2020 challenge to Trump, saying president can learn from challenges (potentially president's matches with president, I have to check the tokenizer)
  2. Mark Lilla says an obsession with identity politics has wrecked US liberalism (Two matching verbs)
michardy commented 7 years ago

Yep. president's becomes president 's

['Trump', 'has', "'inside", 'information', "'", 'on', 'who', 'protested', 'in', 'Charlottesville', ',', 'says', 'Falwell', 'Jr.', 'in', 'president', "'s", 'defense']
michardy commented 7 years ago

Need to remove things like has and is from entities list.
Also president and Trump should be de-duplication targets. In other words Trump or the current president should be replaced with president so that more than one reference to it is removed

michardy commented 7 years ago

Fixed by 303c4b382fdcd2584eee231e2680f790bbc8fb38