piskvorky / gensim

Topic Modelling for Humans
https://radimrehurek.com/gensim
GNU Lesser General Public License v2.1
15.55k stars 4.37k forks source link

CalledProcessError: when running document influence model using dtm-win64.exe in gensim python wrapper #2144

Open dsharmabtg opened 6 years ago

dsharmabtg commented 6 years ago

Dear Sir,

I am able to successfully run the DTM model using dtm-win64.exe in gensim python wrapper. But I am getting error when running the DIM model using the dtm-win64.exe . I am running this using python script in Anaconda windows:

dimModel = DtmModel(dtm_path, corpus, time_slice, num_topics=60,id2word=corpus.dictionary, initialize_lda=True, model='fixed')

After running for almost 2 to 3 hours, the below error comes.

The error below: CalledProcessError: Command '['C:\\dtm_master\\bin\\dtm\\dtm-win64.exe', '--ntopics=60', '--model=fixed', '--mode=fit', '--initialize_lda=true', '--corpus_prefix=C:\\Users\\ADMIN\\AppData\\Local\\Temp\\61138a_train', '--outname=C:\\Users\\ADMIN\\AppData\\Local\\Temp\\61138a_train_out', '--alpha=0.01', '--lda_max_em_iter=10', '--lda_sequence_min_iter=6', '--lda_sequence_max_iter=20', '--top_chain_var=0.005', '--rng_seed=0']' returned non-zero exit status 3

I have tried searching on google but didn't find any help. Could you please help me what this error referring and how to resolve. Many thanks in Advance!!!!!!!

Regards, Deepak

menshikh-iv commented 6 years ago

Hi @deepak2083, can you please share logs too. I found The system cannot find the path specified. as a description of exit status 3 on Win, that's really strange in case if this was running for several hours.

Also, can you share your corpus and time_slice please, I'll try to reproduce your issue on Windows.

dsharmabtg commented 6 years ago

Hi Ivan, Thanks for your reply. I am trying the Dynamic Topic Modelling and Document Influence Model on NIPS papers. The dataset and logfile along with logTraceBack are attached as required. I have taken the time_slice as [4,4,5] for 13 years from 1988~2000. The preprocessing steps I have followed from the following tutorial on Author-Topic model (https://nbviewer.jupyter.org/github/rare-technologies/gensim/blob/develop/docs/notebooks/atmodel_tutorial.ipynb) Thank you so much for your reply. Regards, Deepak logFile_03082018.txt nipsDataset.zip

logTraceBack.txt

menshikh-iv commented 5 years ago

Thanks for info @deepak2083, unfortunatelly I have no windows machine now, if somebody can check it on windows - this will be really appreciated.