voyanttools / VoyantServer

GNU General Public License v3.0
66 stars 8 forks source link

Calculations for distinctive words #31

Closed quinnanya closed 1 year ago

quinnanya commented 1 year ago

Apologies for this question, but I wasn't able to find the details in the user manual or figure out what's going on from the related Spyral documentation: what's going on behind the scenes for calculating the "distinctive words" as part of the summary panel? I can find information about how to use stopword lists with distinctive words, but not how they're calculated. Thanks for any pointers!

ajmacdonald commented 1 year ago

Distinctive words are calculated using tf-idf. I'll add this information to the docs so that it's more clear.

ajmacdonald commented 1 year ago

https://github.com/voyanttools/Voyant/commit/63515dc325be58174b01b8e1feb3719fd061dd97