Improvements to Keywords

karensg / crowd-summary

Crowd Summary Tool

0 stars 1 forks source link

Improvements to Keywords #33

Closed fabcouwer closed 10 years ago

fabcouwer commented 10 years ago

Defining Climate Change has top keywords " climate, change, e, ". There should be a minimum length for keywords and common words ("more") should also be filtered.

MBrouns commented 10 years ago

agreed, will change this. Although it should probably also be fixed when we have more documents due to tfidf working better then

fabcouwer commented 10 years ago

I agree, for now the minimum length change should do (though it shouldn't be too short, consider for example an article about the CIA, FBI and NSA)

MBrouns commented 10 years ago

added a minimum length of 5 and a stopword list

fabcouwer commented 10 years ago

:+1:

MBrouns commented 10 years ago

Made it even better, it now uses stemmed and lowercased keywords cause i.e. in doc 5 Strategic and strategic were both added