Add Topic Modeling module

roik2500 / Reddit-Censorship-or-Moderation

1 stars 1 forks source link

Add Topic Modeling module #2

Open Kagandi opened 2 years ago

Kagandi commented 2 years ago

Write a class that defines topic modeling API
Implement the class using BERTopic
Implement the class using LDA

shimonShouei commented 2 years ago

There is an argument between us. Do we need to make in the classes a function that runs all the pipeline? or should we put it in another module.

Kagandi commented 2 years ago

Example of an api: Reddit.extract_featurs(topic_modeling = [LDA()], haggingface_features=["GoEmotion","BerTweetEmotion"], ner=True) What you are going to pass to the function class or string depends on how generic the implementation and if it has similar api.