search

MaartenGr / BERTopic_evaluation

Code and experiments for *BERTopic: Neural topic modeling with a class-based TF-IDF procedure*
MIT License
65 stars 32 forks source link

Installation help on Evaluation #1

Open dean-rahman opened 2 years ago

dean-rahman commented 2 years ago

Hi Maarten Thank you for contributing BERTopic to the world. I am an MA candidate in Linguistics and I am actually writing my thesis on BERTopic.

Programmingwise, I am at an early-intermediate stage so kindly requesting your patience with my question. I was able to run your BERTopic notebook on a Finnish dataset successfully and experiment with various settings!

However, when it comes to the evaluation notebook, I am already stuck at the installation phase. image

I also tried image Would you have some more detailed documentation on how to complete the installation? Evaluating and comparing the different BERTopic models I have created for the Finnish dataset is the heart of the thesis :) Thank you! --Dean

MaartenGr commented 2 years ago

Hi Dean,

Using pip install evaluation will not install the correct package. Make sure to fork this repository and in the root execute pip install .. That should install the package that you are looking for.

Other than that, the code here is merely for reproducing the BERTopic paper and not so much for general usage. Having said that, it might be interesting to look at the OCTIS and try out the instructions there. That way, it is easier to select the evaluation metrics that you would like to try out in your thesis.

Hopefully, this helps!

dean-rahman commented 2 years ago

Thank you very much for the quick response. Yes, forking correctly, I was able to install everything!

Thanks also for the hint to look into OCTIS.