Kernel dies at the "Extracting topics from clusters using representation models" stage

MaartenGr / BERTopic

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

https://maartengr.github.io/BERTopic/

MIT License

5.83k stars 724 forks source link

Kernel dies at the "Extracting topics from clusters using representation models" stage #1836

Open pjacobetty opened 4 months ago

pjacobetty commented 4 months ago

I used to run BERTopic without a problem on my job's HPC on GPUs but now it seems like it doesn't move beyond this stage: 2024-02-23 12:24:56,663 - BERTopic - Representation - Extracting topics from clusters using representation models. It kills the ipython kernel and it doesn't provide any other info, even though I have verbose=True.

Can you please help me? Thanks!

MaartenGr commented 4 months ago

It's difficult to help out without some additional information. Please provide your full code and the versions of your environment and BERTopic. Moreover, how large is your data, and which GPU are you using? Make sure to be as complete as possible!

pjacobetty commented 4 months ago

Hi Maarten, Thanks for the prompt reply. Your tool is incredibly useful and I really appreciate your work. I'm closing this because I eventually managed to identify the problem: the jupyter binary path was not pointing to the venv despite being active. Thanks again! Great work.