piskvorky / gensim

Topic Modelling for Humans
https://radimrehurek.com/gensim
GNU Lesser General Public License v2.1
15.55k stars 4.37k forks source link

setup Error "Type Error: an integer is required" #256

Closed lvqian closed 9 years ago

lvqian commented 9 years ago

I was tried hundreds times... But something are still wrong. My system is centOS. My python version is 2.6.6 I use yum install numpy scipy

Because the network problem, I can't use "easy_install" or "pip" to get gensim. So, I down the gensim.tar.gz, and unzip it, change location, then, "sudo python setup.py install" the information as follows:

running install running bdist_egg running egg_info writing requirements to gensim.egg-info/requires.txt writing gensim.egg-info/PKG-INFO writing top-level names to gensim.egg-info/top_level.txt writing dependency_links to gensim.egg-info/dependencylinks.txt reading manifest file 'gensim.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' warning: no files found matching '.sh' under directory '.' no previously-included directories found matching 'docs/src_' writing manifest file 'gensim.egg-info/SOURCES.txt' installing library code to build/bdist.linux-x86_64/egg running install_lib running build_py creating build creating build/lib.linux-x86_64-2.6 creating build/lib.linux-x86_64-2.6/gensim copying gensim/utils.py -> build/lib.linux-x86_64-2.6/gensim copying gensim/interfaces.py -> build/lib.linux-x86_64-2.6/gensim copying gensim/matutils.py -> build/lib.linux-x86_64-2.6/gensim copying gensim/nosy.py -> build/lib.linux-x86_64-2.6/gensim copying gensim/init.py -> build/lib.linux-x86_64-2.6/gensim creating build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/ldamallet.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/tfidfmodel.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/tst.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/ldamulticore.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/test.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/lsimodel.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/dtmmodel.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/ldamodel.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/lsi_worker.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/lda_dispatcher.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/lsi_dispatcher.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/saul.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/word2vec.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/logentropy_model.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/lda_worker.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/hdpmodel.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/init.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/rpmodel.py -> build/lib.linux-x86_64-2.6/gensim/models creating build/lib.linux-x86_64-2.6/gensim/scripts copying gensim/scripts/make_wiki_online_lemma.py -> build/lib.linux-x86_64-2.6/gensim/scripts copying gensim/scripts/make_wiki.py -> build/lib.linux-x86_64-2.6/gensim/scripts copying gensim/scripts/make_wikicorpus.py -> build/lib.linux-x86_64-2.6/gensim/scripts copying gensim/scripts/make_wiki_lemma.py -> build/lib.linux-x86_64-2.6/gensim/scripts copying gensim/scripts/make_wiki_online.py -> build/lib.linux-x86_64-2.6/gensim/scripts copying gensim/scripts/make_wiki_online_nodebug.py -> build/lib.linux-x86_64-2.6/gensim/scripts copying gensim/scripts/init.py -> build/lib.linux-x86_64-2.6/gensim/scripts creating build/lib.linux-x86_64-2.6/gensim/parsing copying gensim/parsing/porter.py -> build/lib.linux-x86_64-2.6/gensim/parsing copying gensim/parsing/preprocessing.py -> build/lib.linux-x86_64-2.6/gensim/parsing copying gensim/parsing/init.py -> build/lib.linux-x86_64-2.6/gensim/parsing creating build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/csvcorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/indexedcorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/lowcorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/mmcorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/wikicorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/bleicorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/hashdictionary.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/malletcorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/textcorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/ucicorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/dictionary.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/svmlightcorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/init.py -> build/lib.linux-x86_64-2.6/gensim/corpora creating build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_corpora.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_miislita.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_word2vec.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_corpora_hashdictionary.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_lee.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_utils.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_similarities.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/index_wiki.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_models.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_big.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/svd_error.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/simspeed2.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_parsing.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/init.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_corpora_dictionary.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/simspeed.py -> build/lib.linux-x86_64-2.6/gensim/test creating build/lib.linux-x86_64-2.6/gensim/similarities copying gensim/similarities/docsim.py -> build/lib.linux-x86_64-2.6/gensim/similarities copying gensim/similarities/init.py -> build/lib.linux-x86_64-2.6/gensim/similarities copying gensim/models/voidptr.h -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/word2vec_inner.c -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/word2vec_inner.pyx -> build/lib.linux-x86_64-2.6/gensim/models creating build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/dtm_test -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/head500.noblanks.cor -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/head500.noblanks.cor.bz2 -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/head500.noblanks.cor_tfidf.model -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/head500.noblanks.cor_wordids.txt -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/lee.cor -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/lee_background.cor -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/miIslita.cor -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/para2para_text1.txt -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/para2para_text2.txt -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/similarities0-1.txt -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/test_corpus_ok.mm -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/test_corpus_small.mm -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.blei -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.blei.vocab -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.low -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.mallet -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.mm -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.svmlight -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.txt -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.uci -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.uci.vocab -> build/lib.linux-x86_64-2.6/gensim/test/test_data running build_ext building 'gensim.models.word2vec_inner' extension creating build/temp.linux-x86_64-2.6 creating build/temp.linux-x86_64-2.6/gensim creating build/temp.linux-x86_64-2.6/gensim/models gcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -Igensim/models -I/usr/include/python2.6 -I/usr/lib64/python2.6/site-packages/numpy/core/include -c ./gensim/models/word2vec_inner.c -o build/temp.linux-x86_64-2.6/./gensim/models/word2vec_inner.o unable to execute gcc: No such file or directory command 'gcc' failed with exit status 1 an integer is required Traceback (most recent call last): File "setup.py", line 155, in include_package_data=True, File "/usr/lib64/python2.6/distutils/core.py", line 152, in setup dist.run_commands() File "/usr/lib64/python2.6/distutils/dist.py", line 975, in run_commands self.run_command(cmd) File "/usr/lib64/python2.6/distutils/dist.py", line 995, in run_command cmd_obj.run() File "build/bdist.linux-x86_64/egg/setuptools/command/install.py", line 67, in run File "build/bdist.linux-x86_64/egg/setuptools/command/install.py", line 109, in do_egg_install File "/usr/lib64/python2.6/distutils/cmd.py", line 333, in run_command self.distribution.run_command(command) File "/usr/lib64/python2.6/distutils/dist.py", line 995, in run_command cmd_obj.run() File "build/bdist.linux-x86_64/egg/setuptools/command/bdist_egg.py", line 161, in run File "build/bdist.linux-x86_64/egg/setuptools/command/bdist_egg.py", line 147, in call_command File "/usr/lib64/python2.6/distutils/cmd.py", line 333, in run_command self.distribution.run_command(command) File "/usr/lib64/python2.6/distutils/dist.py", line 995, in run_command cmd_obj.run() File "build/bdist.linux-x86_64/egg/setuptools/command/install_lib.py", line 10, in run File "/usr/lib64/python2.6/distutils/command/install_lib.py", line 119, in build self.run_command('build_ext') File "/usr/lib64/python2.6/distutils/cmd.py", line 333, in run_command self.distribution.run_command(command) File "/usr/lib64/python2.6/distutils/dist.py", line 995, in run_command cmd_obj.run() File "setup.py", line 71, in run "There was an issue with your platform configuration - see above.") TypeError: an integer is required

Please tell me what's wrong. I'm very trouble right now. Thank a lot!

piskvorky commented 9 years ago

unable to execute gcc: No such file or directory

Looks like gcc (the C compiler) is not installed. It shouldn't be necessary to have gcc to install gensim, not sure why the installation fails.

In any case, try installing gcc. On Linux, it's in system package build-essential or similar.

lvqian commented 9 years ago

Thank you so much! It works! Thank you for helping me out!

lvqian commented 9 years ago

But I face a new problem... When I run the "sudo python setup.py test" The program shows:

running test running egg_info writing requirements to gensim.egg-info/requires.txt writing gensim.egg-info/PKG-INFO writing top-level names to gensim.egg-info/top_level.txt writing dependency_links to gensim.egg-info/dependencylinks.txt reading manifest file 'gensim.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' warning: no files found matching '.sh' under directory '.' no previously-included directories found matching 'docs/src_' writing manifest file 'gensim.egg-info/SOURCES.txt' running build_ext copying build/lib.linux-x86_64-2.6/gensim/models/word2vec_inner.so -> gensim/models test_empty_input (gensim.test.test_corpora.TestBleiCorpus) ... ok test_load (gensim.test.test_corpora.TestBleiCorpus) ... ok test_save (gensim.test.test_corpora.TestBleiCorpus) ... ok test_serialize (gensim.test.test_corpora.TestBleiCorpus) ... ok test_serialize_compressed (gensim.test.test_corpora.TestBleiCorpus) ... ok test_switch_id2word (gensim.test.test_corpora.TestBleiCorpus) ... ok test_empty_input (gensim.test.test_corpora.TestLowCorpus) ... ok test_load (gensim.test.test_corpora.TestLowCorpus) ... ok test_save (gensim.test.test_corpora.TestLowCorpus) ... ok test_serialize (gensim.test.test_corpora.TestLowCorpus) ... ok test_serialize_compressed (gensim.test.test_corpora.TestLowCorpus) ... ok test_switch_id2word (gensim.test.test_corpora.TestLowCorpus) ... ok test_empty_input (gensim.test.test_corpora.TestMalletCorpus) ... ok test_load (gensim.test.test_corpora.TestMalletCorpus) ... ok test_load_with_metadata (gensim.test.test_corpora.TestMalletCorpus) ... ok test_save (gensim.test.test_corpora.TestMalletCorpus) ... ok test_serialize (gensim.test.test_corpora.TestMalletCorpus) ... ok test_serialize_compressed (gensim.test.test_corpora.TestMalletCorpus) ... ok test_switch_id2word (gensim.test.test_corpora.TestMalletCorpus) ... ok test_empty_input (gensim.test.test_corpora.TestMmCorpus) ... ok test_load (gensim.test.test_corpora.TestMmCorpus) ... ok test_save (gensim.test.test_corpora.TestMmCorpus) ... ok test_serialize (gensim.test.test_corpora.TestMmCorpus) ... ok test_serialize_compressed (gensim.test.test_corpora.TestMmCorpus) ... ok test_switch_id2word (gensim.test.test_corpora.TestMmCorpus) ... ok test_empty_input (gensim.test.test_corpora.TestSvmLightCorpus) ... ok test_load (gensim.test.test_corpora.TestSvmLightCorpus) ... ok test_save (gensim.test.test_corpora.TestSvmLightCorpus) ... ok test_serialize (gensim.test.test_corpora.TestSvmLightCorpus) ... ok test_serialize_compressed (gensim.test.test_corpora.TestSvmLightCorpus) ... ok test_switch_id2word (gensim.test.test_corpora.TestSvmLightCorpus) ... ok test_empty_input (gensim.test.test_corpora.TestTextCorpus) ... ok test_load (gensim.test.test_corpora.TestTextCorpus) ... ok test_load_with_metadata (gensim.test.test_corpora.TestTextCorpus) ... ok test_save (gensim.test.test_corpora.TestTextCorpus) ... ok test_serialize (gensim.test.test_corpora.TestTextCorpus) ... ok test_serialize_compressed (gensim.test.test_corpora.TestTextCorpus) ... ok test_switch_id2word (gensim.test.test_corpora.TestTextCorpus) ... ok test_empty_input (gensim.test.test_corpora.TestUciCorpus) ... ok test_load (gensim.test.test_corpora.TestUciCorpus) ... ok test_save (gensim.test.test_corpora.TestUciCorpus) ... ok test_serialize (gensim.test.test_corpora.TestUciCorpus) ... ok test_serialize_compressed (gensim.test.test_corpora.TestUciCorpus) ... ok test_switch_id2word (gensim.test.test_corpora.TestUciCorpus) ... ok test_miislita_high_level (gensim.test.test_miislita.TestMiislita) ... ok test_save_load_ability (gensim.test.test_miislita.TestMiislita) ... /home/lvqian/gensim-0.10.2/gensim/interfaces.py:60: UserWarning: corpus.save() stores only the (tiny) iteration object; to serialize the actual corpus content, use e.g. MmCorpus.serialize(corpus) warnings.warn("corpus.save() stores only the (tiny) iteration object; " ok Make sure TextCorpus can be serialized to disk. ... ok Test storing/loading the entire model. ... ok Test word2vec parallel training. ... ok Test storing/loading the entire model. ... ok Test storing/loading the entire model in word2vec format. ... ok Test storing/loading the entire model and vocabulary in word2vec format. ... ok Test word2vec results identical with identical RNG seed. ... ok Test similarity and n_similarity methods. ... ok Test word2vec training. ... ok Test CBOW word2vec training. ... ok Test CBOW (negative sampling) word2vec training. ... ok Test skip-gram (negative sampling) word2vec training. ... ok Test word2vec vocabulary building. ... ok Does LineSentence work with a compressed file object argument? ... ok Does LineSentence work with a filename argument? ... ok Does LineSentence work with a file object argument, rather than filename? ... ok testBuild (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok testDebugMode (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok testDocFreqAndToken2IdForSeveralDocsWithOneWord (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok testDocFreqForOneDocWithSeveralWord (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok testDocFreqOneDoc (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok testFilter (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok testRange (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok HashDictionary can be saved as textfile. ... ok HashDictionary can be saved & loaded as compressed pickle. ... ok availability and integrity of corpus ... ok correlation with human data > 0.6 ... ok test_None (gensim.test.test_utils.TestIsCorpus) ... ok test_int_tuples (gensim.test.test_utils.TestIsCorpus) ... ok test_invalid_formats (gensim.test.test_utils.TestIsCorpus) ... ok test_simple_lists_of_tuples (gensim.test.test_utils.TestIsCorpus) ... ok testChunking (gensim.test.test_similarities.TestMatrixSimilarity) ... ok testFull (gensim.test.test_similarities.TestMatrixSimilarity) ... ok testIter (gensim.test.test_similarities.TestMatrixSimilarity) ... ok testLarge (gensim.test.test_similarities.TestMatrixSimilarity) ... ok testMmap (gensim.test.test_similarities.TestMatrixSimilarity) ... ok testNumBest (gensim.test.test_similarities.TestMatrixSimilarity) ... ok testPersistency (gensim.test.test_similarities.TestMatrixSimilarity) ... ok testChunking (gensim.test.test_similarities.TestSimilarity) ... ok testFull (gensim.test.test_similarities.TestSimilarity) ... ok testIter (gensim.test.test_similarities.TestSimilarity) ... ok testLarge (gensim.test.test_similarities.TestSimilarity) ... ok testMmap (gensim.test.test_similarities.TestSimilarity) ... ok testNumBest (gensim.test.test_similarities.TestSimilarity) ... ok testPersistency (gensim.test.test_similarities.TestSimilarity) ... ok test re-opening partially full shards ... ok testSharding (gensim.test.test_similarities.TestSimilarity) ... ok testChunking (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testFull (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testIter (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testLarge (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testMmap (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testNumBest (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testPersistency (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testLargeMmap (gensim.test.test_models.TestLdaMallet) ... ok testPersistence (gensim.test.test_models.TestLdaMallet) ... ok testTransform (gensim.test.test_models.TestLdaMallet) ... ok testLargeMmap (gensim.test.test_models.TestLdaModel) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity WARNING:gensim.models.ldamodel:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy ok testPersistence (gensim.test.test_models.TestLdaModel) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity WARNING:gensim.models.ldamodel:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy ok testTopicSeeding (gensim.test.test_models.TestLdaModel) ... ok testTransform (gensim.test.test_models.TestLdaModel) ... ok testLargeMmap (gensim.test.test_models.TestLdaMulticore) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity WARNING:gensim.models.ldamulticore:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy ok testPersistence (gensim.test.test_models.TestLdaMulticore) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity WARNING:gensim.models.ldamulticore:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy ok testTopicSeeding (gensim.test.test_models.TestLdaMulticore) ... ok testTransform (gensim.test.test_models.TestLdaMulticore) ... ok testPersistence (gensim.test.test_models.TestLogEntropyModel) ... ok testTransform (gensim.test.test_models.TestLogEntropyModel) ... ok Test lsi[corpus] transformation. ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity ok testLargeMmap (gensim.test.test_models.TestLsiModel) ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity /usr/lib64/python2.6/site-packages/scipy/sparse/compressed.py:129: UserWarning: indices array has non-integer dtype (float64) % self.indices.dtype.name ) ok testOnlineTransform (gensim.test.test_models.TestLsiModel) ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity ok testPersistence (gensim.test.test_models.TestLsiModel) ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity ok Test lsi[vector] transformation. ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity ok testPersistence (gensim.test.test_models.TestRpModel) ... ok testTransform (gensim.test.test_models.TestRpModel) ... ok testInit (gensim.test.test_models.TestTfidfModel) ... ok testPersistence (gensim.test.test_models.TestTfidfModel) ... ok testTransform (gensim.test.test_models.TestTfidfModel) ... ok testSplitAlphanum (gensim.test.test_parsing.TestPreprocessing) ... ok testStemText (gensim.test.test_parsing.TestPreprocessing) ... ok testStripMultipleWhitespaces (gensim.test.test_parsing.TestPreprocessing) ... ok testStripNonAlphanum (gensim.test.test_parsing.TestPreprocessing) ... ok testStripNumeric (gensim.test.test_parsing.TestPreprocessing) ... ok testStripShort (gensim.test.test_parsing.TestPreprocessing) ... ok testStripStopwords (gensim.test.test_parsing.TestPreprocessing) ... ok testStripTags (gensim.test.test_parsing.TestPreprocessing) ... ok testBuild (gensim.test.test_corpora_dictionary.TestDictionary) ... ok testDocFreqAndToken2IdForSeveralDocsWithOneWord (gensim.test.test_corpora_dictionary.TestDictionary) ... ok testDocFreqForOneDocWithSeveralWord (gensim.test.test_corpora_dictionary.TestDictionary) ... ok testDocFreqOneDoc (gensim.test.test_corpora_dictionary.TestDictionary) ... ok testFilter (gensim.test.test_corpora_dictionary.TestDictionary) ... ok Test Python 2 dict-like interface in both Python 2 and 3. ... ok test_doc2bow (gensim.test.test_corpora_dictionary.TestDictionary) ... ok build Dictionary from an existing corpus ... ERROR Dictionary can be saved as textfile and loaded again from textfile. ... ok

ERROR: build Dictionary from an existing corpus

Traceback (most recent call last): File "/home/lvqian/gensim-0.10.2/gensim/test/test_corpora_dictionary.py", line 180, in test_from_corpus bow = gensim.matutils.Sparse2Corpus(scipy.sparse.rand(10, 100)) AttributeError: 'module' object has no attribute 'rand'


Ran 140 tests in 330.349s

running test running egg_info writing requirements to gensim.egg-info/requires.txt writing gensim.egg-info/PKG-INFO writing top-level names to gensim.egg-info/top_level.txt writing dependency_links to gensim.egg-info/dependencylinks.txt reading manifest file 'gensim.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' warning: no files found matching '.sh' under directory '.' no previously-included directories found matching 'docs/src_' writing manifest file 'gensim.egg-info/SOURCES.txt' running build_ext copying build/lib.linux-x86_64-2.6/gensim/models/word2vec_inner.so -> gensim/models test_empty_input (gensim.test.test_corpora.TestBleiCorpus) ... ok test_load (gensim.test.test_corpora.TestBleiCorpus) ... ok test_save (gensim.test.test_corpora.TestBleiCorpus) ... ok test_serialize (gensim.test.test_corpora.TestBleiCorpus) ... ok test_serialize_compressed (gensim.test.test_corpora.TestBleiCorpus) ... ok test_switch_id2word (gensim.test.test_corpora.TestBleiCorpus) ... ok test_empty_input (gensim.test.test_corpora.TestLowCorpus) ... ok test_load (gensim.test.test_corpora.TestLowCorpus) ... ok test_save (gensim.test.test_corpora.TestLowCorpus) ... ok test_serialize (gensim.test.test_corpora.TestLowCorpus) ... ok test_serialize_compressed (gensim.test.test_corpora.TestLowCorpus) ... ok test_switch_id2word (gensim.test.test_corpora.TestLowCorpus) ... ok test_empty_input (gensim.test.test_corpora.TestMalletCorpus) ... ok test_load (gensim.test.test_corpora.TestMalletCorpus) ... ok test_load_with_metadata (gensim.test.test_corpora.TestMalletCorpus) ... ok test_save (gensim.test.test_corpora.TestMalletCorpus) ... ok test_serialize (gensim.test.test_corpora.TestMalletCorpus) ... ok test_serialize_compressed (gensim.test.test_corpora.TestMalletCorpus) ... ok test_switch_id2word (gensim.test.test_corpora.TestMalletCorpus) ... ok test_empty_input (gensim.test.test_corpora.TestMmCorpus) ... ok test_load (gensim.test.test_corpora.TestMmCorpus) ... ok test_save (gensim.test.test_corpora.TestMmCorpus) ... ok test_serialize (gensim.test.test_corpora.TestMmCorpus) ... ok test_serialize_compressed (gensim.test.test_corpora.TestMmCorpus) ... ok test_switch_id2word (gensim.test.test_corpora.TestMmCorpus) ... ok test_empty_input (gensim.test.test_corpora.TestSvmLightCorpus) ... ok test_load (gensim.test.test_corpora.TestSvmLightCorpus) ... ok test_save (gensim.test.test_corpora.TestSvmLightCorpus) ... ok test_serialize (gensim.test.test_corpora.TestSvmLightCorpus) ... ok test_serialize_compressed (gensim.test.test_corpora.TestSvmLightCorpus) ... ok test_switch_id2word (gensim.test.test_corpora.TestSvmLightCorpus) ... ok test_empty_input (gensim.test.test_corpora.TestTextCorpus) ... ok test_load (gensim.test.test_corpora.TestTextCorpus) ... ok test_load_with_metadata (gensim.test.test_corpora.TestTextCorpus) ... ok test_save (gensim.test.test_corpora.TestTextCorpus) ... ok test_serialize (gensim.test.test_corpora.TestTextCorpus) ... ok test_serialize_compressed (gensim.test.test_corpora.TestTextCorpus) ... ok test_switch_id2word (gensim.test.test_corpora.TestTextCorpus) ... ok test_empty_input (gensim.test.test_corpora.TestUciCorpus) ... ok test_load (gensim.test.test_corpora.TestUciCorpus) ... ok test_save (gensim.test.test_corpora.TestUciCorpus) ... ok test_serialize (gensim.test.test_corpora.TestUciCorpus) ... ok test_serialize_compressed (gensim.test.test_corpora.TestUciCorpus) ... ok test_switch_id2word (gensim.test.test_corpora.TestUciCorpus) ... ok test_miislita_high_level (gensim.test.test_miislita.TestMiislita) ... ok test_save_load_ability (gensim.test.test_miislita.TestMiislita) ... /home/lvqian/gensim-0.10.2/gensim/interfaces.py:60: UserWarning: corpus.save() stores only the (tiny) iteration object; to serialize the actual corpus content, use e.g. MmCorpus.serialize(corpus) warnings.warn("corpus.save() stores only the (tiny) iteration object; " ok Make sure TextCorpus can be serialized to disk. ... ok Test storing/loading the entire model. ... ok Test word2vec parallel training. ... ok Test storing/loading the entire model. ... ok Test storing/loading the entire model in word2vec format. ... ok Test storing/loading the entire model and vocabulary in word2vec format. ... ok Test word2vec results identical with identical RNG seed. ... ok Test similarity and n_similarity methods. ... ok Test word2vec training. ... ok Test CBOW word2vec training. ... ok Test CBOW (negative sampling) word2vec training. ... ok Test skip-gram (negative sampling) word2vec training. ... ok Test word2vec vocabulary building. ... ok Does LineSentence work with a compressed file object argument? ... ok Does LineSentence work with a filename argument? ... ok Does LineSentence work with a file object argument, rather than filename? ... ok testBuild (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok testDebugMode (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok testDocFreqAndToken2IdForSeveralDocsWithOneWord (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok testDocFreqForOneDocWithSeveralWord (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok testDocFreqOneDoc (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok testFilter (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok testRange (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok HashDictionary can be saved as textfile. ... ok HashDictionary can be saved & loaded as compressed pickle. ... ok availability and integrity of corpus ... ok correlation with human data > 0.6 ... ok test_None (gensim.test.test_utils.TestIsCorpus) ... ok test_int_tuples (gensim.test.test_utils.TestIsCorpus) ... ok test_invalid_formats (gensim.test.test_utils.TestIsCorpus) ... ok test_simple_lists_of_tuples (gensim.test.test_utils.TestIsCorpus) ... ok testChunking (gensim.test.test_similarities.TestMatrixSimilarity) ... ok testFull (gensim.test.test_similarities.TestMatrixSimilarity) ... ok testIter (gensim.test.test_similarities.TestMatrixSimilarity) ... ok testLarge (gensim.test.test_similarities.TestMatrixSimilarity) ... ok testMmap (gensim.test.test_similarities.TestMatrixSimilarity) ... ok testNumBest (gensim.test.test_similarities.TestMatrixSimilarity) ... ok testPersistency (gensim.test.test_similarities.TestMatrixSimilarity) ... ok testChunking (gensim.test.test_similarities.TestSimilarity) ... ok testFull (gensim.test.test_similarities.TestSimilarity) ... ok testIter (gensim.test.test_similarities.TestSimilarity) ... ok testLarge (gensim.test.test_similarities.TestSimilarity) ... ok testMmap (gensim.test.test_similarities.TestSimilarity) ... ok testNumBest (gensim.test.test_similarities.TestSimilarity) ... ok testPersistency (gensim.test.test_similarities.TestSimilarity) ... ok test re-opening partially full shards ... ok testSharding (gensim.test.test_similarities.TestSimilarity) ... ok testChunking (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testFull (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testIter (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testLarge (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testMmap (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testNumBest (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testPersistency (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testLargeMmap (gensim.test.test_models.TestLdaMallet) ... ok testPersistence (gensim.test.test_models.TestLdaMallet) ... ok testTransform (gensim.test.test_models.TestLdaMallet) ... ok testLargeMmap (gensim.test.test_models.TestLdaModel) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity WARNING:gensim.models.ldamodel:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy ok testPersistence (gensim.test.test_models.TestLdaModel) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity WARNING:gensim.models.ldamodel:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy ok testTopicSeeding (gensim.test.test_models.TestLdaModel) ... ok testTransform (gensim.test.test_models.TestLdaModel) ... ok testLargeMmap (gensim.test.test_models.TestLdaMulticore) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity WARNING:gensim.models.ldamulticore:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy ok testPersistence (gensim.test.test_models.TestLdaMulticore) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity WARNING:gensim.models.ldamulticore:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy ok testTopicSeeding (gensim.test.test_models.TestLdaMulticore) ... ok testTransform (gensim.test.test_models.TestLdaMulticore) ... ok testPersistence (gensim.test.test_models.TestLogEntropyModel) ... ok testTransform (gensim.test.test_models.TestLogEntropyModel) ... ok Test lsi[corpus] transformation. ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity ok testLargeMmap (gensim.test.test_models.TestLsiModel) ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity /usr/lib64/python2.6/site-packages/scipy/sparse/compressed.py:129: UserWarning: indices array has non-integer dtype (float64) % self.indices.dtype.name ) ok testOnlineTransform (gensim.test.test_models.TestLsiModel) ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity ok testPersistence (gensim.test.test_models.TestLsiModel) ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity ok Test lsi[vector] transformation. ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity ok testPersistence (gensim.test.test_models.TestRpModel) ... ok testTransform (gensim.test.test_models.TestRpModel) ... ok testInit (gensim.test.test_models.TestTfidfModel) ... ok testPersistence (gensim.test.test_models.TestTfidfModel) ... ok testTransform (gensim.test.test_models.TestTfidfModel) ... ok testSplitAlphanum (gensim.test.test_parsing.TestPreprocessing) ... ok testStemText (gensim.test.test_parsing.TestPreprocessing) ... ok testStripMultipleWhitespaces (gensim.test.test_parsing.TestPreprocessing) ... ok testStripNonAlphanum (gensim.test.test_parsing.TestPreprocessing) ... ok testStripNumeric (gensim.test.test_parsing.TestPreprocessing) ... ok testStripShort (gensim.test.test_parsing.TestPreprocessing) ... ok testStripStopwords (gensim.test.test_parsing.TestPreprocessing) ... ok testStripTags (gensim.test.test_parsing.TestPreprocessing) ... ok testBuild (gensim.test.test_corpora_dictionary.TestDictionary) ... ok testDocFreqAndToken2IdForSeveralDocsWithOneWord (gensim.test.test_corpora_dictionary.TestDictionary) ... ok testDocFreqForOneDocWithSeveralWord (gensim.test.test_corpora_dictionary.TestDictionary) ... ok testDocFreqOneDoc (gensim.test.test_corpora_dictionary.TestDictionary) ... ok testFilter (gensim.test.test_corpora_dictionary.TestDictionary) ... ok Test Python 2 dict-like interface in both Python 2 and 3. ... ok test_doc2bow (gensim.test.test_corpora_dictionary.TestDictionary) ... ok build Dictionary from an existing corpus ... ERROR Dictionary can be saved as textfile and loaded again from textfile. ... ok

ERROR: build Dictionary from an existing corpus

Traceback (most recent call last): File "/home/lvqian/gensim-0.10.2/gensim/test/test_corpora_dictionary.py", line 180, in test_from_corpus bow = gensim.matutils.Sparse2Corpus(scipy.sparse.rand(10, 100)) AttributeError: 'module' object has no attribute 'rand'


Ran 140 tests in 330.349s

FAILED (errors=1)

why?

piskvorky commented 9 years ago

What scipy version?

lvqian commented 9 years ago

scipy.x86_64 0:0.7.2-8.el6 I use "sudo yum install scipy"

lvqian commented 9 years ago

I try to remove numpy, scipy and "sudo yum install numpy scipy python-matplotlib ipython python-pandas sympy python-nose" the "sudo python setup.py test" still FAILED(errors=1)

ERROR: build Dictionary from an existing corpus

Traceback (most recent call last): File "/home/lvqian/gensim-0.10.2/gensim/test/test_corpora_dictionary.py", line 180, in test_from_corpus bow = gensim.matutils.Sparse2Corpus(scipy.sparse.rand(10, 100)) AttributeError: 'module' object has no attribute 'rand'


Ran 140 tests in 330.305s

FAILED (errors=1)

lvqian commented 9 years ago

These are installing informations:

Running Transaction Installing : numpy-1.4.1-9.el6.x86_64 1/4 Installing : numpy-f2py-1.4.1-9.el6.x86_64 2/4 Installing : scipy-0.7.2-8.el6.x86_64 3/4 Installing : python-matplotlib-0.99.1.2-1.el6.x86_64 4/4 Verifying : python-matplotlib-0.99.1.2-1.el6.x86_64 1/4 Verifying : scipy-0.7.2-8.el6.x86_64 2/4 Verifying : numpy-f2py-1.4.1-9.el6.x86_64 3/4 Verifying : numpy-1.4.1-9.el6.x86_64 4/4

Installed: numpy.x86_64 0:1.4.1-9.el6 python-matplotlib.x86_64 0:0.99.1.2-1.el6 scipy.x86_64 0:0.7.2-8.el6

Dependency Installed: numpy-f2py.x86_64 0:1.4.1-9.el6

cscorley commented 9 years ago

Hi,

Seems like this test relies on a function that was introduced (as best as I can gather), in Scipy 0.9.

I don't think there's a major problem other than the test case should be fixed. You could also try installing scipy though another route other than your package manager in order to get the latest version (like pip).

@piskvorky I think it would be a good idea to have Travis test on the minimum versions specified by the setup.py. Is that something possible to do with Travis/conda?

lvqian commented 9 years ago

I can't use pip or easy_install, Because the network... I tried install scipy by scipy.tar.gz, But there are may reliable program...

I tried to fix the network, also failed...

cscorley commented 9 years ago

You should be able to build/install new numpy & scipy from it's source with the following packages installed prior:

yum install atlas blas lapack gcc gcc-gfortran python-devel

Hope that helps!

lvqian commented 9 years ago

I only install there package..

Package Arch Version Repository Size

Installing: blas x86_64 3.2.1-4.el6 base 321 k gcc-gfortran x86_64 4.4.7-11.el6 base 4.7 M lapack x86_64 3.2.1-4.el6 base 4.3 M

Transaction Summary

Install 3 Package(s)

Then, I run" sudo python setup.py install" to install scipy But still failed...

/usr/lib64/python2.6/distutils/dist.py:266: UserWarning: Unknown distribution option: 'test_suite' warnings.warn(msg) blas_opt_info: blas_mkl_info: libraries mkl,vml,guide not found in ['/usr/local/lib64', '/usr/local/lib', '/usr/lib64', '/usr/lib'] NOT AVAILABLE

openblas_info: libraries openblas not found in ['/usr/local/lib64', '/usr/local/lib', '/usr/lib64', '/usr/lib'] NOT AVAILABLE

atlas_blas_threads_info: Setting PTATLAS=ATLAS libraries ptf77blas,ptcblas,atlas not found in ['/usr/local/lib64', '/usr/local/lib', '/usr/lib64/atlas', '/usr/lib64/sse2', '/usr/lib64', '/usr/lib'] NOT AVAILABLE

atlas_blas_info: libraries f77blas,cblas,atlas not found in ['/usr/local/lib64', '/usr/local/lib', '/usr/lib64/atlas', '/usr/lib64/sse2', '/usr/lib64', '/usr/lib'] NOT AVAILABLE

/usr/lib64/python2.6/site-packages/numpy/distutils/system_info.py:1526: UserWarning: Atlas (http://math-atlas.sourceforge.net/) libraries not found. Directories to search for the libraries can be specified in the numpy/distutils/site.cfg file (section [atlas]) or by setting the ATLAS environment variable. warnings.warn(AtlasNotFoundError.doc) blas_info: libraries blas not found in ['/usr/local/lib64', '/usr/local/lib', '/usr/lib64', '/usr/lib'] NOT AVAILABLE

/usr/lib64/python2.6/site-packages/numpy/distutils/system_info.py:1535: UserWarning: Blas (http://www.netlib.org/blas/) libraries not found. Directories to search for the libraries can be specified in the numpy/distutils/site.cfg file (section [blas]) or by setting the BLAS environment variable. warnings.warn(BlasNotFoundError.doc) blas_src_info: NOT AVAILABLE

/usr/lib64/python2.6/site-packages/numpy/distutils/system_info.py:1538: UserWarning: Blas (http://www.netlib.org/blas/) sources not found. Directories to search for the sources can be specified in the numpy/distutils/site.cfg file (section [blas_src]) or by setting the BLAS_SRC environment variable. warnings.warn(BlasSrcNotFoundError.doc) Traceback (most recent call last): File "setup.py", line 237, in setup_package() File "setup.py", line 234, in setup_package setup(_metadata) File "/usr/lib64/python2.6/site-packages/numpy/distutils/core.py", line 135, in setup config = configuration() File "setup.py", line 173, in configuration config.add_subpackage('scipy') File "/usr/lib64/python2.6/site-packages/numpy/distutils/misc_util.py", line 966, in add_subpackage caller_level = 2) File "/usr/lib64/python2.6/site-packages/numpy/distutils/misc_util.py", line 935, in get_subpackage caller_level = caller_level + 1) File "/usr/lib64/python2.6/site-packages/numpy/distutils/misc_util.py", line 872, in _get_configuration_from_setup_py config = setup_module.configuration(_args) File "scipy/setup.py", line 12, in configuration config.add_subpackage('integrate') File "/usr/lib64/python2.6/site-packages/numpy/distutils/misc_util.py", line 966, in add_subpackage caller_level = 2) File "/usr/lib64/python2.6/site-packages/numpy/distutils/misc_util.py", line 935, in get_subpackage caller_level = caller_level + 1) File "/usr/lib64/python2.6/site-packages/numpy/distutils/misc_util.py", line 872, in _get_configuration_from_setup_py config = setup_module.configuration(args) File "scipy/integrate/setup.py", line 12, in configuration blas_opt = get_info('blas_opt',notfound_action=2) File "/usr/lib64/python2.6/site-packages/numpy/distutils/system_info.py", line 356, in get_info return cl().get_info(notfound_action) File "/usr/lib64/python2.6/site-packages/numpy/distutils/system_info.py", line 514, in get_info raise self.notfounderror(self.notfounderror.doc) numpy.distutils.system_info.BlasNotFoundError: Blas (http://www.netlib.org/blas/) libraries not found. Directories to search for the libraries can be specified in the numpy/distutils/site.cfg file (section [blas]) or by setting the BLAS environment variable.

piskvorky commented 9 years ago

@lvqian did you install ATLAS, like Chris suggested?

@cscorley agreed, Travis should check against the earliest supported version (scipy 0.7.0 in this case).

Not difficult IMO, but I'm a bit swamped with work at the moment. Debugging that LdaMulticore would be on top of my open-source stack, this I'd say is low priority, so not sure when I'll get to it. Help welcome :)

I'll open a new issue for this so we don't forget.

lvqian commented 9 years ago

I tried the windows platform... But still failed... Please help me T T

cmd_obj.run()

File "build\bdist.win32\egg\setuptools\command\egg_info.py", line 168, in run File "build\bdist.win32\egg\setuptools\command\egg_info.py", line 193, in find _sources File "build\bdist.win32\egg\setuptools\command\egg_info.py", line 277, in run File "build\bdist.win32\egg\setuptools\command\egginfo.py", line 306, in add defaults File "build\bdist.win32\egg\setuptools\command\sdist.py", line 185, in add_def aults File "C:\Python27\lib\distutils\cmd.py", line 312, in get_finalized_command cmd_obj.run() File "build\bdist.win32\egg\setuptools\command\egg_info.py", line 168, in run File "build\bdist.win32\egg\setuptools\command\egg_info.py", line 193, in find _sources cmd_obj.ensure_finalized() File "C:\Python27\lib\distutils\cmd.py", line 109, in ensure_finalized File "build\bdist.win32\egg\setuptools\command\egg_info.py", line 277, in run File "build\bdist.win32\egg\setuptools\command\egginfo.py", line 306, in add defaults self.finalize_options() File "E:\windows\gensim-0.10.2\setup.py", line 90, in finalize_options File "build\bdist.win32\egg\setuptools\command\sdist.py", line 185, in add_def aults builtins.NUMPY_SETUP = False File "C:\Python27\lib\distutils\cmd.py", line 312, in get_finalized_command AttributeError: 'dict' object has no attribute 'NUMPY_SETUP' cmd_obj.ensure_finalized() File "C:\Python27\lib\distutils\cmd.py", line 109, in ensure_finalized self.finalize_options() File "E:\windows\gensim-0.10.2\setup.py", line 90, in finalize_options builtins.NUMPY_SETUP = False AttributeError: 'dict' object has no attribute 'NUMPY_SETUP' ok testReopen (gensim.test.test_similarities.TestSimilarity) test re-opening partially full shards ... ok testSharding (gensim.test.test_similarities.TestSimilarity) ... ok testChunking (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testFull (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testIter (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testLarge (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testMmap (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testNumBest (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testPersistency (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... o k test_None (gensim.test.test_utils.TestIsCorpus) ... ok test_int_tuples (gensim.test.test_utils.TestIsCorpus) ... ok test_invalid_formats (gensim.test.test_utils.TestIsCorpus) ... ok test_simple_lists_of_tuples (gensim.test.test_utils.TestIsCorpus) ... ok testLargeMmap (gensim.test.test_word2vec.TestWord2VecModel) Test storing/loading the entire model. ... ok testParallel (gensim.test.test_word2vec.TestWord2VecModel) Test word2vec parallel training. ... ok testPersistence (gensim.test.test_word2vec.TestWord2VecModel) Test storing/loading the entire model. ... ok testPersistenceWord2VecFormat (gensim.test.test_word2vec.TestWord2VecModel) Test storing/loading the entire model in word2vec format. ... ok testPersistenceWord2VecFormatWithVocab (gensim.test.test_word2vec.TestWord2VecMo del) Test storing/loading the entire model and vocabulary in word2vec format. ... ok testRNG (gensim.test.test_word2vec.TestWord2VecModel) Test word2vec results identical with identical RNG seed. ... ok testSimilarities (gensim.test.test_word2vec.TestWord2VecModel) Test similarity and n_similarity methods. ... WARNING:gensim.models.word2vec:con sider setting layer size to a multiple of 4 for greater performance ok testTraining (gensim.test.test_word2vec.TestWord2VecModel) Test word2vec training. ... WARNING:gensim.models.word2vec:consider setting laye r size to a multiple of 4 for greater performance WARNING:gensim.models.word2vec:consider setting layer size to a multiple of 4 fo r greater performance ok testTrainingCbow (gensim.test.test_word2vec.TestWord2VecModel) Test CBOW word2vec training. ... WARNING:gensim.models.word2vec:consider setting layer size to a multiple of 4 for greater performance WARNING:gensim.models.word2vec:consider setting layer size to a multiple of 4 fo r greater performance ok testTrainingCbowNegative (gensim.test.test_word2vec.TestWord2VecModel) Test CBOW (negative sampling) word2vec training. ... WARNING:gensim.models.word2 vec:consider setting layer size to a multiple of 4 for greater performance WARNING:gensim.models.word2vec:consider setting layer size to a multiple of 4 fo r greater performance ok testTrainingSgNegative (gensim.test.test_word2vec.TestWord2VecModel) Test skip-gram (negative sampling) word2vec training. ... WARNING:gensim.models. word2vec:consider setting layer size to a multiple of 4 for greater performance WARNING:gensim.models.word2vec:consider setting layer size to a multiple of 4 fo r greater performance ok testVocab (gensim.test.test_word2vec.TestWord2VecModel) Test word2vec vocabulary building. ... ok testLineSentenceWorksWithCompressedFile (gensim.test.test_word2vec.TestWord2VecS entenceIterators) Does LineSentence work with a compressed file object argument? ... ok testLineSentenceWorksWithFilename (gensim.test.test_word2vec.TestWord2VecSentenc eIterators) Does LineSentence work with a filename argument? ... ok testLineSentenceWorksWithNormalFile (gensim.test.test_word2vec.TestWord2VecSente nceIterators) Does LineSentence work with a file object argument, rather than filename? ... ok

ERROR: testLargeMmap (gensim.test.test_models.TestLdaMulticore)

Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 348, in testL argeMmap model = ldamulticore.LdaMulticore(self.corpus, num_topics=2) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 136, in init gamma_threshold=gamma_threshold) File "e:\windows\gensim-0.10.2\gensim\models\ldamodel.py", line 313, in init self.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x05DCF930>: it's not fou nd as gensim.models.ldamulticore.worker_e_step

ERROR: testPersistence (gensim.test.test_models.TestLdaMulticore)

Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 339, in testP ersistence model = ldamulticore.LdaMulticore(self.corpus, num_topics=2) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 136, in init gamma_threshold=gamma_threshold) File "e:\windows\gensim-0.10.2\gensim\models\ldamodel.py", line 313, in init self.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x05DCF930>: it's not fou nd as gensim.models.ldamulticore.worker_e_step

ERROR: testTopicSeeding (gensim.test.test_models.TestLdaMulticore)

Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 320, in testT opicSeeding model.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x05DCF930>: it's not fou nd as gensim.models.ldamulticore.worker_e_step

ERROR: testTransform (gensim.test.test_models.TestLdaMulticore)

Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 289, in testT ransform model.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x05DCF930>: it's not fou nd as gensim.models.ldamulticore.worker_e_step


Ran 140 tests in 128.791s

FAILED (errors=4)

E:\windows\gensim-0.10.2>

lvqian commented 9 years ago

When I run "python setup.py test" on windows I always face the PicklingError FAILED

details as follows builtins.NUMPY_SETUP = False AttributeError : prepare(preparation_data) ' File "C:\Python27\lib\multiprocessing\forking.py", line 495, in prepare dict' object has no attribute 'NUMPY_SETUP' 'parents_main', file, path_name, etc File "E:\windows\gensim-0.10.2\setup.py", line 155, in include_package_data=True, File "C:\Python27\lib\distutils\core.py", line 152, in setup dist.run_commands() File "C:\Python27\lib\distutils\dist.py", line 953, in run_commands self.run_command(cmd) File "C:\Python27\lib\distutils\dist.py", line 972, in run_command cmd_obj.run() File "build\bdist.win32\egg\setuptools\command\test.py", line 142, in run File "build\bdist.win32\egg\setuptools\command\test.py", line 106, in with_pro ject_on_sys_path File "C:\Python27\lib\distutils\cmd.py", line 326, in run_command self.distribution.run_command(command) File "C:\Python27\lib\distutils\dist.py", line 972, in run_command cmd_obj.run() File "build\bdist.win32\egg\setuptools\command\egg_info.py", line 168, in run File "build\bdist.win32\egg\setuptools\command\egg_info.py", line 193, in find _sources File "build\bdist.win32\egg\setuptools\command\egg_info.py", line 277, in run File "build\bdist.win32\egg\setuptools\command\egginfo.py", line 306, in add defaults File "build\bdist.win32\egg\setuptools\command\sdist.py", line 185, in add_def aults File "C:\Python27\lib\distutils\cmd.py", line 312, in get_finalized_command cmd_obj.ensure_finalized() File "C:\Python27\lib\distutils\cmd.py", line 109, in ensure_finalized self.finalize_options() File "E:\windows\gensim-0.10.2\setup.py", line 90, in finalize_options builtins.NUMPY_SETUP = False AttributeError: 'dict' object has no attribute 'NUMPY_SETUP' ok testChunking (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testFull (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testIter (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testLarge (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testMmap (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testNumBest (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testPersistency (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... o k test_None (gensim.test.test_utils.TestIsCorpus) ... ok test_int_tuples (gensim.test.test_utils.TestIsCorpus) ... ok test_invalid_formats (gensim.test.test_utils.TestIsCorpus) ... ok test_simple_lists_of_tuples (gensim.test.test_utils.TestIsCorpus) ... ok testLargeMmap (gensim.test.test_word2vec.TestWord2VecModel) Test storing/loading the entire model. ... ok testParallel (gensim.test.test_word2vec.TestWord2VecModel) Test word2vec parallel training. ... ok testPersistence (gensim.test.test_word2vec.TestWord2VecModel) Test storing/loading the entire model. ... ok testPersistenceWord2VecFormat (gensim.test.test_word2vec.TestWord2VecModel) Test storing/loading the entire model in word2vec format. ... ok testPersistenceWord2VecFormatWithVocab (gensim.test.test_word2vec.TestWord2VecMo del) Test storing/loading the entire model and vocabulary in word2vec format. ... ok testRNG (gensim.test.test_word2vec.TestWord2VecModel) Test word2vec results identical with identical RNG seed. ... ok testSimilarities (gensim.test.test_word2vec.TestWord2VecModel) Test similarity and n_similarity methods. ... WARNING:gensim.models.word2vec:con sider setting layer size to a multiple of 4 for greater performance ok testTraining (gensim.test.test_word2vec.TestWord2VecModel) Test word2vec training. ... WARNING:gensim.models.word2vec:consider setting laye r size to a multiple of 4 for greater performance WARNING:gensim.models.word2vec:consider setting layer size to a multiple of 4 fo r greater performance ok testTrainingCbow (gensim.test.test_word2vec.TestWord2VecModel) Test CBOW word2vec training. ... WARNING:gensim.models.word2vec:consider setting layer size to a multiple of 4 for greater performance WARNING:gensim.models.word2vec:consider setting layer size to a multiple of 4 fo r greater performance ok testTrainingCbowNegative (gensim.test.test_word2vec.TestWord2VecModel) Test CBOW (negative sampling) word2vec training. ... WARNING:gensim.models.word2 vec:consider setting layer size to a multiple of 4 for greater performance WARNING:gensim.models.word2vec:consider setting layer size to a multiple of 4 fo r greater performance ok testTrainingSgNegative (gensim.test.test_word2vec.TestWord2VecModel) Test skip-gram (negative sampling) word2vec training. ... WARNING:gensim.models. word2vec:consider setting layer size to a multiple of 4 for greater performance WARNING:gensim.models.word2vec:consider setting layer size to a multiple of 4 fo r greater performance ok testVocab (gensim.test.test_word2vec.TestWord2VecModel) Test word2vec vocabulary building. ... ok testLineSentenceWorksWithCompressedFile (gensim.test.test_word2vec.TestWord2VecS entenceIterators) Does LineSentence work with a compressed file object argument? ... ok testLineSentenceWorksWithFilename (gensim.test.test_word2vec.TestWord2VecSentenc eIterators) Does LineSentence work with a filename argument? ... ok testLineSentenceWorksWithNormalFile (gensim.test.test_word2vec.TestWord2VecSente nceIterators) Does LineSentence work with a file object argument, rather than filename? ... ok

ERROR: testLargeMmap (gensim.test.test_models.TestLdaMulticore)

Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 348, in testL argeMmap model = ldamulticore.LdaMulticore(self.corpus, num_topics=2) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 136, in init gamma_threshold=gamma_threshold) File "e:\windows\gensim-0.10.2\gensim\models\ldamodel.py", line 313, in init self.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x049386B0>: it's not fou nd as gensim.models.ldamulticore.worker_e_step

ERROR: testPersistence (gensim.test.test_models.TestLdaMulticore)

Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 339, in testP ersistence model = ldamulticore.LdaMulticore(self.corpus, num_topics=2) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 136, in init gamma_threshold=gamma_threshold) File "e:\windows\gensim-0.10.2\gensim\models\ldamodel.py", line 313, in init self.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x049386B0>: it's not fou nd as gensim.models.ldamulticore.worker_e_step

ERROR: testTopicSeeding (gensim.test.test_models.TestLdaMulticore)

Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 320, in testT opicSeeding model.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x049386B0>: it's not fou nd as gensim.models.ldamulticore.worker_e_step

ERROR: testTransform (gensim.test.test_models.TestLdaMulticore)

Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 289, in testT ransform model.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x049386B0>: it's not fou nd as gensim.models.ldamulticore.worker_e_step


Ran 140 tests in 129.716s

FAILED (errors=4)