add ability to prune topics based on certain criteria

TommyJones / tidylda

Implements an algorithim for Latent Dirichlet Allocation using style conventions from the [tidyverse](https://style.tidyverse.org/) and [tidymodels](https://tidymodels.github.io/model-implementation-principles/index.html).

Other

41 stars 3 forks source link

add ability to prune topics based on certain criteria #63

Open TommyJones opened 2 years ago

TommyJones commented 2 years ago

to do this, you'd have to

remove columns from theta
reweight the rows of theta to add to 1
remove rows from beta
remove columns from Cd (in counts)
remove rows from Cv (in counts)
re-distribute tokens from the columns of Cd and rows of Cv
- might be able to use tidylda:::recover_counts_from_probs() for this