HesitantlyHuman / hatespace

Novel Archetypal Analysis NLP on hateful text corpora.
4 stars 1 forks source link

Create some sort of ELBO test utility. #5

Open HesitantlyHuman opened 2 years ago

HesitantlyHuman commented 2 years ago

Since we may want to run the ELBO test on various datasets, it would behoove us to have some sort of easy to use function which will run the test.

As for the implementation of said utility: In the interest of speed and ease, the transformer models should be fixed after the first run of the ELBO test. This test should be of high dimensionality, after which we will just assume that there is enough information latent in the transformer models that we can run the rest of the ELBO tests.