search

saeeddhqan / Maryam

Maryam: Open-source Intelligence(OSINT) Framework
GNU General Public License v3.0
1.01k stars 166 forks source link

The initial version of the Topic Modeling modules (v0.1.0) #269

Closed keamanansiber closed 2 years ago

keamanansiber commented 2 years ago

The initial version of the Topic Modeling modules (v0.1.0), contributed by Hatma Suryotrisongko, consists of:

TESTED USING = topicmodeling -i mixed.json -t json -m all-distilroberta-v1 topicmodeling -i mixed.json -t json -s -v -m all-distilroberta-v1 topicmodeling -i mixed.json -t json -s -m all-distilroberta-v1 topicmodeling -i mixed.json -t json -v -m all-distilroberta-v1 topicmodeling -i testdataset.csv -t csv -m all-mpnet-base-v2 topicmodeling -i testdataset.csv -t csv -s -v -m all-mpnet-base-v2 topicmodeling -i testdataset.csv -t csv -s -m all-mpnet-base-v2 topicmodeling -i testdataset.csv -t csv -v -m all-mpnet-base-v2

Note: download the dataset for testing from https://github.com/keamanansiber/Maryam/tree/master/notebooks

saeeddhqan commented 2 years ago

I'll review the pr when there is no change.

k4u5h1k commented 2 years ago

Another error I got was this

image

This is because we have a script named plotly.py in the iris directory and python seems to think this is the plotly module. Please go ahead and rename it.

keamanansiber commented 2 years ago

I have followed your suggestion, by renaming the plotly.py

In addition, I also added the --output and --api functionality. Tested by using = topicmodeling -i mixed.json -t json -m all-distilroberta-v1 --output report json testreport iris/topicmodeling topicmodeling -i mixed.json -t json -m all-distilroberta-v1 --api