Remove duplicate LOI's from processing

gordonwatts / snowmass-loi-words

4 stars 1 forks source link

Closed gordonwatts closed 4 years ago

gordonwatts commented 4 years ago

Write out a local duplicate list (checked into git for local reference)
Re-order so duplicate removal happens early
Alter the load methods so that duplicate files are not used in any word clouds or the cluster
Re-run everything.

Fixes #42