Sotera / watchman

Watchman: An open-source social-media event-detection system
GNU General Public License v2.0
20 stars 7 forks source link

Use Caffe "prop" layer and new comparison logic #111

Open kenglish-pfi opened 7 years ago

kenglish-pfi commented 7 years ago

Tweak image featurization to use "prob" layer and max-probability dot product matching logic.

IPython notebook tests using the night/day:concert/riot data sets found improved results with some minor changes to our image featurization logic. Changes needed:

  1. Currently use "fc7" layer of the cafe model, switch to "prob"
  2. Currently aggregate overall cluster vector via averaging each sub-element, switch to selecting max value of each element.
  3. Currently compare aggregate cluster vector to candidate using cosine similarity, switch to using dot-product.