Closed lvqian closed 9 years ago
unable to execute gcc: No such file or directory
Looks like gcc (the C compiler) is not installed. It shouldn't be necessary to have gcc to install gensim, not sure why the installation fails.
In any case, try installing gcc. On Linux, it's in system package build-essential
or similar.
Thank you so much! It works! Thank you for helping me out!
But I face a new problem... When I run the "sudo python setup.py test" The program shows:
running test
running egg_info
writing requirements to gensim.egg-info/requires.txt
writing gensim.egg-info/PKG-INFO
writing top-level names to gensim.egg-info/top_level.txt
writing dependency_links to gensim.egg-info/dependencylinks.txt
reading manifest file 'gensim.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching '.sh' under directory '.'
no previously-included directories found matching 'docs/src_'
writing manifest file 'gensim.egg-info/SOURCES.txt'
running build_ext
copying build/lib.linux-x86_64-2.6/gensim/models/word2vec_inner.so -> gensim/models
test_empty_input (gensim.test.test_corpora.TestBleiCorpus) ... ok
test_load (gensim.test.test_corpora.TestBleiCorpus) ... ok
test_save (gensim.test.test_corpora.TestBleiCorpus) ... ok
test_serialize (gensim.test.test_corpora.TestBleiCorpus) ... ok
test_serialize_compressed (gensim.test.test_corpora.TestBleiCorpus) ... ok
test_switch_id2word (gensim.test.test_corpora.TestBleiCorpus) ... ok
test_empty_input (gensim.test.test_corpora.TestLowCorpus) ... ok
test_load (gensim.test.test_corpora.TestLowCorpus) ... ok
test_save (gensim.test.test_corpora.TestLowCorpus) ... ok
test_serialize (gensim.test.test_corpora.TestLowCorpus) ... ok
test_serialize_compressed (gensim.test.test_corpora.TestLowCorpus) ... ok
test_switch_id2word (gensim.test.test_corpora.TestLowCorpus) ... ok
test_empty_input (gensim.test.test_corpora.TestMalletCorpus) ... ok
test_load (gensim.test.test_corpora.TestMalletCorpus) ... ok
test_load_with_metadata (gensim.test.test_corpora.TestMalletCorpus) ... ok
test_save (gensim.test.test_corpora.TestMalletCorpus) ... ok
test_serialize (gensim.test.test_corpora.TestMalletCorpus) ... ok
test_serialize_compressed (gensim.test.test_corpora.TestMalletCorpus) ... ok
test_switch_id2word (gensim.test.test_corpora.TestMalletCorpus) ... ok
test_empty_input (gensim.test.test_corpora.TestMmCorpus) ... ok
test_load (gensim.test.test_corpora.TestMmCorpus) ... ok
test_save (gensim.test.test_corpora.TestMmCorpus) ... ok
test_serialize (gensim.test.test_corpora.TestMmCorpus) ... ok
test_serialize_compressed (gensim.test.test_corpora.TestMmCorpus) ... ok
test_switch_id2word (gensim.test.test_corpora.TestMmCorpus) ... ok
test_empty_input (gensim.test.test_corpora.TestSvmLightCorpus) ... ok
test_load (gensim.test.test_corpora.TestSvmLightCorpus) ... ok
test_save (gensim.test.test_corpora.TestSvmLightCorpus) ... ok
test_serialize (gensim.test.test_corpora.TestSvmLightCorpus) ... ok
test_serialize_compressed (gensim.test.test_corpora.TestSvmLightCorpus) ... ok
test_switch_id2word (gensim.test.test_corpora.TestSvmLightCorpus) ... ok
test_empty_input (gensim.test.test_corpora.TestTextCorpus) ... ok
test_load (gensim.test.test_corpora.TestTextCorpus) ... ok
test_load_with_metadata (gensim.test.test_corpora.TestTextCorpus) ... ok
test_save (gensim.test.test_corpora.TestTextCorpus) ... ok
test_serialize (gensim.test.test_corpora.TestTextCorpus) ... ok
test_serialize_compressed (gensim.test.test_corpora.TestTextCorpus) ... ok
test_switch_id2word (gensim.test.test_corpora.TestTextCorpus) ... ok
test_empty_input (gensim.test.test_corpora.TestUciCorpus) ... ok
test_load (gensim.test.test_corpora.TestUciCorpus) ... ok
test_save (gensim.test.test_corpora.TestUciCorpus) ... ok
test_serialize (gensim.test.test_corpora.TestUciCorpus) ... ok
test_serialize_compressed (gensim.test.test_corpora.TestUciCorpus) ... ok
test_switch_id2word (gensim.test.test_corpora.TestUciCorpus) ... ok
test_miislita_high_level (gensim.test.test_miislita.TestMiislita) ... ok
test_save_load_ability (gensim.test.test_miislita.TestMiislita) ... /home/lvqian/gensim-0.10.2/gensim/interfaces.py:60: UserWarning: corpus.save() stores only the (tiny) iteration object; to serialize the actual corpus content, use e.g. MmCorpus.serialize(corpus)
warnings.warn("corpus.save() stores only the (tiny) iteration object; "
ok
Make sure TextCorpus can be serialized to disk. ... ok
Test storing/loading the entire model. ... ok
Test word2vec parallel training. ... ok
Test storing/loading the entire model. ... ok
Test storing/loading the entire model in word2vec format. ... ok
Test storing/loading the entire model and vocabulary in word2vec format. ... ok
Test word2vec results identical with identical RNG seed. ... ok
Test similarity and n_similarity methods. ... ok
Test word2vec training. ... ok
Test CBOW word2vec training. ... ok
Test CBOW (negative sampling) word2vec training. ... ok
Test skip-gram (negative sampling) word2vec training. ...
ok
Test word2vec vocabulary building. ... ok
Does LineSentence work with a compressed file object argument? ... ok
Does LineSentence work with a filename argument? ... ok
Does LineSentence work with a file object argument, rather than filename? ... ok
testBuild (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok
testDebugMode (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok
testDocFreqAndToken2IdForSeveralDocsWithOneWord (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok
testDocFreqForOneDocWithSeveralWord (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok
testDocFreqOneDoc (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok
testFilter (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok
testRange (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok
HashDictionary
can be saved as textfile. ... ok
HashDictionary
can be saved & loaded as compressed pickle. ... ok
availability and integrity of corpus ... ok
correlation with human data > 0.6 ... ok
test_None (gensim.test.test_utils.TestIsCorpus) ... ok
test_int_tuples (gensim.test.test_utils.TestIsCorpus) ... ok
test_invalid_formats (gensim.test.test_utils.TestIsCorpus) ... ok
test_simple_lists_of_tuples (gensim.test.test_utils.TestIsCorpus) ... ok
testChunking (gensim.test.test_similarities.TestMatrixSimilarity) ... ok
testFull (gensim.test.test_similarities.TestMatrixSimilarity) ... ok
testIter (gensim.test.test_similarities.TestMatrixSimilarity) ... ok
testLarge (gensim.test.test_similarities.TestMatrixSimilarity) ... ok
testMmap (gensim.test.test_similarities.TestMatrixSimilarity) ... ok
testNumBest (gensim.test.test_similarities.TestMatrixSimilarity) ... ok
testPersistency (gensim.test.test_similarities.TestMatrixSimilarity) ... ok
testChunking (gensim.test.test_similarities.TestSimilarity) ... ok
testFull (gensim.test.test_similarities.TestSimilarity) ... ok
testIter (gensim.test.test_similarities.TestSimilarity) ... ok
testLarge (gensim.test.test_similarities.TestSimilarity) ... ok
testMmap (gensim.test.test_similarities.TestSimilarity) ... ok
testNumBest (gensim.test.test_similarities.TestSimilarity) ... ok
testPersistency (gensim.test.test_similarities.TestSimilarity) ... ok
test re-opening partially full shards ... ok
testSharding (gensim.test.test_similarities.TestSimilarity) ... ok
testChunking (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok
testFull (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok
testIter (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok
testLarge (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok
testMmap (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok
testNumBest (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok
testPersistency (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok
testLargeMmap (gensim.test.test_models.TestLdaMallet) ... ok
testPersistence (gensim.test.test_models.TestLdaMallet) ... ok
testTransform (gensim.test.test_models.TestLdaMallet) ... ok
testLargeMmap (gensim.test.test_models.TestLdaModel) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity
WARNING:gensim.models.ldamodel:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy
ok
testPersistence (gensim.test.test_models.TestLdaModel) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity
WARNING:gensim.models.ldamodel:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy
ok
testTopicSeeding (gensim.test.test_models.TestLdaModel) ... ok
testTransform (gensim.test.test_models.TestLdaModel) ... ok
testLargeMmap (gensim.test.test_models.TestLdaMulticore) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity
WARNING:gensim.models.ldamulticore:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy
ok
testPersistence (gensim.test.test_models.TestLdaMulticore) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity
WARNING:gensim.models.ldamulticore:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy
ok
testTopicSeeding (gensim.test.test_models.TestLdaMulticore) ... ok
testTransform (gensim.test.test_models.TestLdaMulticore) ... ok
testPersistence (gensim.test.test_models.TestLogEntropyModel) ... ok
testTransform (gensim.test.test_models.TestLogEntropyModel) ... ok
Test lsi[corpus] transformation. ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity
ok
testLargeMmap (gensim.test.test_models.TestLsiModel) ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity
/usr/lib64/python2.6/site-packages/scipy/sparse/compressed.py:129: UserWarning: indices array has non-integer dtype (float64)
% self.indices.dtype.name )
ok
testOnlineTransform (gensim.test.test_models.TestLsiModel) ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity
ok
testPersistence (gensim.test.test_models.TestLsiModel) ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity
ok
Test lsi[vector] transformation. ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity
ok
testPersistence (gensim.test.test_models.TestRpModel) ... ok
testTransform (gensim.test.test_models.TestRpModel) ... ok
testInit (gensim.test.test_models.TestTfidfModel) ... ok
testPersistence (gensim.test.test_models.TestTfidfModel) ... ok
testTransform (gensim.test.test_models.TestTfidfModel) ... ok
testSplitAlphanum (gensim.test.test_parsing.TestPreprocessing) ... ok
testStemText (gensim.test.test_parsing.TestPreprocessing) ... ok
testStripMultipleWhitespaces (gensim.test.test_parsing.TestPreprocessing) ... ok
testStripNonAlphanum (gensim.test.test_parsing.TestPreprocessing) ... ok
testStripNumeric (gensim.test.test_parsing.TestPreprocessing) ... ok
testStripShort (gensim.test.test_parsing.TestPreprocessing) ... ok
testStripStopwords (gensim.test.test_parsing.TestPreprocessing) ... ok
testStripTags (gensim.test.test_parsing.TestPreprocessing) ... ok
testBuild (gensim.test.test_corpora_dictionary.TestDictionary) ... ok
testDocFreqAndToken2IdForSeveralDocsWithOneWord (gensim.test.test_corpora_dictionary.TestDictionary) ... ok
testDocFreqForOneDocWithSeveralWord (gensim.test.test_corpora_dictionary.TestDictionary) ... ok
testDocFreqOneDoc (gensim.test.test_corpora_dictionary.TestDictionary) ... ok
testFilter (gensim.test.test_corpora_dictionary.TestDictionary) ... ok
Test Python 2 dict-like interface in both Python 2 and 3. ... ok
test_doc2bow (gensim.test.test_corpora_dictionary.TestDictionary) ... ok
build Dictionary
from an existing corpus ... ERROR
Dictionary
can be saved as textfile and loaded again from textfile. ... ok
Dictionary
from an existing corpusTraceback (most recent call last): File "/home/lvqian/gensim-0.10.2/gensim/test/test_corpora_dictionary.py", line 180, in test_from_corpus bow = gensim.matutils.Sparse2Corpus(scipy.sparse.rand(10, 100)) AttributeError: 'module' object has no attribute 'rand'
Ran 140 tests in 330.349s
running test
running egg_info
writing requirements to gensim.egg-info/requires.txt
writing gensim.egg-info/PKG-INFO
writing top-level names to gensim.egg-info/top_level.txt
writing dependency_links to gensim.egg-info/dependencylinks.txt
reading manifest file 'gensim.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching '.sh' under directory '.'
no previously-included directories found matching 'docs/src_'
writing manifest file 'gensim.egg-info/SOURCES.txt'
running build_ext
copying build/lib.linux-x86_64-2.6/gensim/models/word2vec_inner.so -> gensim/models
test_empty_input (gensim.test.test_corpora.TestBleiCorpus) ... ok
test_load (gensim.test.test_corpora.TestBleiCorpus) ... ok
test_save (gensim.test.test_corpora.TestBleiCorpus) ... ok
test_serialize (gensim.test.test_corpora.TestBleiCorpus) ... ok
test_serialize_compressed (gensim.test.test_corpora.TestBleiCorpus) ... ok
test_switch_id2word (gensim.test.test_corpora.TestBleiCorpus) ... ok
test_empty_input (gensim.test.test_corpora.TestLowCorpus) ... ok
test_load (gensim.test.test_corpora.TestLowCorpus) ... ok
test_save (gensim.test.test_corpora.TestLowCorpus) ... ok
test_serialize (gensim.test.test_corpora.TestLowCorpus) ... ok
test_serialize_compressed (gensim.test.test_corpora.TestLowCorpus) ... ok
test_switch_id2word (gensim.test.test_corpora.TestLowCorpus) ... ok
test_empty_input (gensim.test.test_corpora.TestMalletCorpus) ... ok
test_load (gensim.test.test_corpora.TestMalletCorpus) ... ok
test_load_with_metadata (gensim.test.test_corpora.TestMalletCorpus) ... ok
test_save (gensim.test.test_corpora.TestMalletCorpus) ... ok
test_serialize (gensim.test.test_corpora.TestMalletCorpus) ... ok
test_serialize_compressed (gensim.test.test_corpora.TestMalletCorpus) ... ok
test_switch_id2word (gensim.test.test_corpora.TestMalletCorpus) ... ok
test_empty_input (gensim.test.test_corpora.TestMmCorpus) ... ok
test_load (gensim.test.test_corpora.TestMmCorpus) ... ok
test_save (gensim.test.test_corpora.TestMmCorpus) ... ok
test_serialize (gensim.test.test_corpora.TestMmCorpus) ... ok
test_serialize_compressed (gensim.test.test_corpora.TestMmCorpus) ... ok
test_switch_id2word (gensim.test.test_corpora.TestMmCorpus) ... ok
test_empty_input (gensim.test.test_corpora.TestSvmLightCorpus) ... ok
test_load (gensim.test.test_corpora.TestSvmLightCorpus) ... ok
test_save (gensim.test.test_corpora.TestSvmLightCorpus) ... ok
test_serialize (gensim.test.test_corpora.TestSvmLightCorpus) ... ok
test_serialize_compressed (gensim.test.test_corpora.TestSvmLightCorpus) ... ok
test_switch_id2word (gensim.test.test_corpora.TestSvmLightCorpus) ... ok
test_empty_input (gensim.test.test_corpora.TestTextCorpus) ... ok
test_load (gensim.test.test_corpora.TestTextCorpus) ... ok
test_load_with_metadata (gensim.test.test_corpora.TestTextCorpus) ... ok
test_save (gensim.test.test_corpora.TestTextCorpus) ... ok
test_serialize (gensim.test.test_corpora.TestTextCorpus) ... ok
test_serialize_compressed (gensim.test.test_corpora.TestTextCorpus) ... ok
test_switch_id2word (gensim.test.test_corpora.TestTextCorpus) ... ok
test_empty_input (gensim.test.test_corpora.TestUciCorpus) ... ok
test_load (gensim.test.test_corpora.TestUciCorpus) ... ok
test_save (gensim.test.test_corpora.TestUciCorpus) ... ok
test_serialize (gensim.test.test_corpora.TestUciCorpus) ... ok
test_serialize_compressed (gensim.test.test_corpora.TestUciCorpus) ... ok
test_switch_id2word (gensim.test.test_corpora.TestUciCorpus) ... ok
test_miislita_high_level (gensim.test.test_miislita.TestMiislita) ... ok
test_save_load_ability (gensim.test.test_miislita.TestMiislita) ... /home/lvqian/gensim-0.10.2/gensim/interfaces.py:60: UserWarning: corpus.save() stores only the (tiny) iteration object; to serialize the actual corpus content, use e.g. MmCorpus.serialize(corpus)
warnings.warn("corpus.save() stores only the (tiny) iteration object; "
ok
Make sure TextCorpus can be serialized to disk. ... ok
Test storing/loading the entire model. ... ok
Test word2vec parallel training. ... ok
Test storing/loading the entire model. ... ok
Test storing/loading the entire model in word2vec format. ... ok
Test storing/loading the entire model and vocabulary in word2vec format. ... ok
Test word2vec results identical with identical RNG seed. ... ok
Test similarity and n_similarity methods. ... ok
Test word2vec training. ... ok
Test CBOW word2vec training. ... ok
Test CBOW (negative sampling) word2vec training. ... ok
Test skip-gram (negative sampling) word2vec training. ...
ok
Test word2vec vocabulary building. ... ok
Does LineSentence work with a compressed file object argument? ... ok
Does LineSentence work with a filename argument? ... ok
Does LineSentence work with a file object argument, rather than filename? ... ok
testBuild (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok
testDebugMode (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok
testDocFreqAndToken2IdForSeveralDocsWithOneWord (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok
testDocFreqForOneDocWithSeveralWord (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok
testDocFreqOneDoc (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok
testFilter (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok
testRange (gensim.test.test_corpora_hashdictionary.TestHashDictionary) ... ok
HashDictionary
can be saved as textfile. ... ok
HashDictionary
can be saved & loaded as compressed pickle. ... ok
availability and integrity of corpus ... ok
correlation with human data > 0.6 ... ok
test_None (gensim.test.test_utils.TestIsCorpus) ... ok
test_int_tuples (gensim.test.test_utils.TestIsCorpus) ... ok
test_invalid_formats (gensim.test.test_utils.TestIsCorpus) ... ok
test_simple_lists_of_tuples (gensim.test.test_utils.TestIsCorpus) ... ok
testChunking (gensim.test.test_similarities.TestMatrixSimilarity) ... ok
testFull (gensim.test.test_similarities.TestMatrixSimilarity) ... ok
testIter (gensim.test.test_similarities.TestMatrixSimilarity) ... ok
testLarge (gensim.test.test_similarities.TestMatrixSimilarity) ... ok
testMmap (gensim.test.test_similarities.TestMatrixSimilarity) ... ok
testNumBest (gensim.test.test_similarities.TestMatrixSimilarity) ... ok
testPersistency (gensim.test.test_similarities.TestMatrixSimilarity) ... ok
testChunking (gensim.test.test_similarities.TestSimilarity) ... ok
testFull (gensim.test.test_similarities.TestSimilarity) ... ok
testIter (gensim.test.test_similarities.TestSimilarity) ... ok
testLarge (gensim.test.test_similarities.TestSimilarity) ... ok
testMmap (gensim.test.test_similarities.TestSimilarity) ... ok
testNumBest (gensim.test.test_similarities.TestSimilarity) ... ok
testPersistency (gensim.test.test_similarities.TestSimilarity) ... ok
test re-opening partially full shards ... ok
testSharding (gensim.test.test_similarities.TestSimilarity) ... ok
testChunking (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok
testFull (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok
testIter (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok
testLarge (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok
testMmap (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok
testNumBest (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok
testPersistency (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok
testLargeMmap (gensim.test.test_models.TestLdaMallet) ... ok
testPersistence (gensim.test.test_models.TestLdaMallet) ... ok
testTransform (gensim.test.test_models.TestLdaMallet) ... ok
testLargeMmap (gensim.test.test_models.TestLdaModel) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity
WARNING:gensim.models.ldamodel:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy
ok
testPersistence (gensim.test.test_models.TestLdaModel) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity
WARNING:gensim.models.ldamodel:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy
ok
testTopicSeeding (gensim.test.test_models.TestLdaModel) ... ok
testTransform (gensim.test.test_models.TestLdaModel) ... ok
testLargeMmap (gensim.test.test_models.TestLdaMulticore) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity
WARNING:gensim.models.ldamulticore:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy
ok
testPersistence (gensim.test.test_models.TestLdaMulticore) ... WARNING:gensim.models.ldamodel:no word id mapping provided; initializing from corpus, assuming identity
WARNING:gensim.models.ldamulticore:too few updates, training might not converge; consider increasing the number of passes or iterations to improve accuracy
ok
testTopicSeeding (gensim.test.test_models.TestLdaMulticore) ... ok
testTransform (gensim.test.test_models.TestLdaMulticore) ... ok
testPersistence (gensim.test.test_models.TestLogEntropyModel) ... ok
testTransform (gensim.test.test_models.TestLogEntropyModel) ... ok
Test lsi[corpus] transformation. ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity
ok
testLargeMmap (gensim.test.test_models.TestLsiModel) ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity
/usr/lib64/python2.6/site-packages/scipy/sparse/compressed.py:129: UserWarning: indices array has non-integer dtype (float64)
% self.indices.dtype.name )
ok
testOnlineTransform (gensim.test.test_models.TestLsiModel) ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity
ok
testPersistence (gensim.test.test_models.TestLsiModel) ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity
ok
Test lsi[vector] transformation. ... WARNING:gensim.models.lsimodel:no word id mapping provided; initializing from corpus, assuming identity
ok
testPersistence (gensim.test.test_models.TestRpModel) ... ok
testTransform (gensim.test.test_models.TestRpModel) ... ok
testInit (gensim.test.test_models.TestTfidfModel) ... ok
testPersistence (gensim.test.test_models.TestTfidfModel) ... ok
testTransform (gensim.test.test_models.TestTfidfModel) ... ok
testSplitAlphanum (gensim.test.test_parsing.TestPreprocessing) ... ok
testStemText (gensim.test.test_parsing.TestPreprocessing) ... ok
testStripMultipleWhitespaces (gensim.test.test_parsing.TestPreprocessing) ... ok
testStripNonAlphanum (gensim.test.test_parsing.TestPreprocessing) ... ok
testStripNumeric (gensim.test.test_parsing.TestPreprocessing) ... ok
testStripShort (gensim.test.test_parsing.TestPreprocessing) ... ok
testStripStopwords (gensim.test.test_parsing.TestPreprocessing) ... ok
testStripTags (gensim.test.test_parsing.TestPreprocessing) ... ok
testBuild (gensim.test.test_corpora_dictionary.TestDictionary) ... ok
testDocFreqAndToken2IdForSeveralDocsWithOneWord (gensim.test.test_corpora_dictionary.TestDictionary) ... ok
testDocFreqForOneDocWithSeveralWord (gensim.test.test_corpora_dictionary.TestDictionary) ... ok
testDocFreqOneDoc (gensim.test.test_corpora_dictionary.TestDictionary) ... ok
testFilter (gensim.test.test_corpora_dictionary.TestDictionary) ... ok
Test Python 2 dict-like interface in both Python 2 and 3. ... ok
test_doc2bow (gensim.test.test_corpora_dictionary.TestDictionary) ... ok
build Dictionary
from an existing corpus ... ERROR
Dictionary
can be saved as textfile and loaded again from textfile. ... ok
Dictionary
from an existing corpusTraceback (most recent call last): File "/home/lvqian/gensim-0.10.2/gensim/test/test_corpora_dictionary.py", line 180, in test_from_corpus bow = gensim.matutils.Sparse2Corpus(scipy.sparse.rand(10, 100)) AttributeError: 'module' object has no attribute 'rand'
Ran 140 tests in 330.349s
FAILED (errors=1)
why?
What scipy version?
scipy.x86_64 0:0.7.2-8.el6 I use "sudo yum install scipy"
I try to remove numpy, scipy and "sudo yum install numpy scipy python-matplotlib ipython python-pandas sympy python-nose" the "sudo python setup.py test" still FAILED(errors=1)
Dictionary
from an existing corpusTraceback (most recent call last): File "/home/lvqian/gensim-0.10.2/gensim/test/test_corpora_dictionary.py", line 180, in test_from_corpus bow = gensim.matutils.Sparse2Corpus(scipy.sparse.rand(10, 100)) AttributeError: 'module' object has no attribute 'rand'
Ran 140 tests in 330.305s
FAILED (errors=1)
These are installing informations:
Running Transaction Installing : numpy-1.4.1-9.el6.x86_64 1/4 Installing : numpy-f2py-1.4.1-9.el6.x86_64 2/4 Installing : scipy-0.7.2-8.el6.x86_64 3/4 Installing : python-matplotlib-0.99.1.2-1.el6.x86_64 4/4 Verifying : python-matplotlib-0.99.1.2-1.el6.x86_64 1/4 Verifying : scipy-0.7.2-8.el6.x86_64 2/4 Verifying : numpy-f2py-1.4.1-9.el6.x86_64 3/4 Verifying : numpy-1.4.1-9.el6.x86_64 4/4
Installed: numpy.x86_64 0:1.4.1-9.el6 python-matplotlib.x86_64 0:0.99.1.2-1.el6 scipy.x86_64 0:0.7.2-8.el6
Dependency Installed: numpy-f2py.x86_64 0:1.4.1-9.el6
Hi,
Seems like this test relies on a function that was introduced (as best as I can gather), in Scipy 0.9.
I don't think there's a major problem other than the test case should be fixed. You could also try installing scipy though another route other than your package manager in order to get the latest version (like pip
).
@piskvorky I think it would be a good idea to have Travis test on the minimum versions specified by the setup.py. Is that something possible to do with Travis/conda?
I can't use pip or easy_install, Because the network... I tried install scipy by scipy.tar.gz, But there are may reliable program...
I tried to fix the network, also failed...
You should be able to build/install new numpy & scipy from it's source with the following packages installed prior:
yum install atlas blas lapack gcc gcc-gfortran python-devel
Hope that helps!
I only install there package..
Installing: blas x86_64 3.2.1-4.el6 base 321 k gcc-gfortran x86_64 4.4.7-11.el6 base 4.7 M lapack x86_64 3.2.1-4.el6 base 4.3 M
Install 3 Package(s)
Then, I run" sudo python setup.py install" to install scipy But still failed...
/usr/lib64/python2.6/distutils/dist.py:266: UserWarning: Unknown distribution option: 'test_suite' warnings.warn(msg) blas_opt_info: blas_mkl_info: libraries mkl,vml,guide not found in ['/usr/local/lib64', '/usr/local/lib', '/usr/lib64', '/usr/lib'] NOT AVAILABLE
openblas_info: libraries openblas not found in ['/usr/local/lib64', '/usr/local/lib', '/usr/lib64', '/usr/lib'] NOT AVAILABLE
atlas_blas_threads_info: Setting PTATLAS=ATLAS libraries ptf77blas,ptcblas,atlas not found in ['/usr/local/lib64', '/usr/local/lib', '/usr/lib64/atlas', '/usr/lib64/sse2', '/usr/lib64', '/usr/lib'] NOT AVAILABLE
atlas_blas_info: libraries f77blas,cblas,atlas not found in ['/usr/local/lib64', '/usr/local/lib', '/usr/lib64/atlas', '/usr/lib64/sse2', '/usr/lib64', '/usr/lib'] NOT AVAILABLE
/usr/lib64/python2.6/site-packages/numpy/distutils/system_info.py:1526: UserWarning: Atlas (http://math-atlas.sourceforge.net/) libraries not found. Directories to search for the libraries can be specified in the numpy/distutils/site.cfg file (section [atlas]) or by setting the ATLAS environment variable. warnings.warn(AtlasNotFoundError.doc) blas_info: libraries blas not found in ['/usr/local/lib64', '/usr/local/lib', '/usr/lib64', '/usr/lib'] NOT AVAILABLE
/usr/lib64/python2.6/site-packages/numpy/distutils/system_info.py:1535: UserWarning: Blas (http://www.netlib.org/blas/) libraries not found. Directories to search for the libraries can be specified in the numpy/distutils/site.cfg file (section [blas]) or by setting the BLAS environment variable. warnings.warn(BlasNotFoundError.doc) blas_src_info: NOT AVAILABLE
/usr/lib64/python2.6/site-packages/numpy/distutils/system_info.py:1538: UserWarning:
Blas (http://www.netlib.org/blas/) sources not found.
Directories to search for the sources can be specified in the
numpy/distutils/site.cfg file (section [blas_src]) or by setting
the BLAS_SRC environment variable.
warnings.warn(BlasSrcNotFoundError.doc)
Traceback (most recent call last):
File "setup.py", line 237, in
@lvqian did you install ATLAS, like Chris suggested?
@cscorley agreed, Travis should check against the earliest supported version (scipy 0.7.0 in this case).
Not difficult IMO, but I'm a bit swamped with work at the moment. Debugging that LdaMulticore would be on top of my open-source stack, this I'd say is low priority, so not sure when I'll get to it. Help welcome :)
I'll open a new issue for this so we don't forget.
I tried the windows platform... But still failed... Please help me T T
cmd_obj.run()
File "build\bdist.win32\egg\setuptools\command\egg_info.py", line 168, in run File "build\bdist.win32\egg\setuptools\command\egg_info.py", line 193, in find _sources File "build\bdist.win32\egg\setuptools\command\egg_info.py", line 277, in run File "build\bdist.win32\egg\setuptools\command\egginfo.py", line 306, in add defaults File "build\bdist.win32\egg\setuptools\command\sdist.py", line 185, in add_def aults File "C:\Python27\lib\distutils\cmd.py", line 312, in get_finalized_command cmd_obj.run() File "build\bdist.win32\egg\setuptools\command\egg_info.py", line 168, in run File "build\bdist.win32\egg\setuptools\command\egg_info.py", line 193, in find _sources cmd_obj.ensure_finalized() File "C:\Python27\lib\distutils\cmd.py", line 109, in ensure_finalized File "build\bdist.win32\egg\setuptools\command\egg_info.py", line 277, in run File "build\bdist.win32\egg\setuptools\command\egginfo.py", line 306, in add defaults self.finalize_options() File "E:\windows\gensim-0.10.2\setup.py", line 90, in finalize_options File "build\bdist.win32\egg\setuptools\command\sdist.py", line 185, in add_def aults builtins.NUMPY_SETUP = False File "C:\Python27\lib\distutils\cmd.py", line 312, in get_finalized_command AttributeError: 'dict' object has no attribute 'NUMPY_SETUP' cmd_obj.ensure_finalized() File "C:\Python27\lib\distutils\cmd.py", line 109, in ensure_finalized self.finalize_options() File "E:\windows\gensim-0.10.2\setup.py", line 90, in finalize_options builtins.NUMPY_SETUP = False AttributeError: 'dict' object has no attribute 'NUMPY_SETUP' ok testReopen (gensim.test.test_similarities.TestSimilarity) test re-opening partially full shards ... ok testSharding (gensim.test.test_similarities.TestSimilarity) ... ok testChunking (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testFull (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testIter (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testLarge (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testMmap (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testNumBest (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... ok testPersistency (gensim.test.test_similarities.TestSparseMatrixSimilarity) ... o k test_None (gensim.test.test_utils.TestIsCorpus) ... ok test_int_tuples (gensim.test.test_utils.TestIsCorpus) ... ok test_invalid_formats (gensim.test.test_utils.TestIsCorpus) ... ok test_simple_lists_of_tuples (gensim.test.test_utils.TestIsCorpus) ... ok testLargeMmap (gensim.test.test_word2vec.TestWord2VecModel) Test storing/loading the entire model. ... ok testParallel (gensim.test.test_word2vec.TestWord2VecModel) Test word2vec parallel training. ... ok testPersistence (gensim.test.test_word2vec.TestWord2VecModel) Test storing/loading the entire model. ... ok testPersistenceWord2VecFormat (gensim.test.test_word2vec.TestWord2VecModel) Test storing/loading the entire model in word2vec format. ... ok testPersistenceWord2VecFormatWithVocab (gensim.test.test_word2vec.TestWord2VecMo del) Test storing/loading the entire model and vocabulary in word2vec format. ... ok testRNG (gensim.test.test_word2vec.TestWord2VecModel) Test word2vec results identical with identical RNG seed. ... ok testSimilarities (gensim.test.test_word2vec.TestWord2VecModel) Test similarity and n_similarity methods. ... WARNING:gensim.models.word2vec:con sider setting layer size to a multiple of 4 for greater performance ok testTraining (gensim.test.test_word2vec.TestWord2VecModel) Test word2vec training. ... WARNING:gensim.models.word2vec:consider setting laye r size to a multiple of 4 for greater performance WARNING:gensim.models.word2vec:consider setting layer size to a multiple of 4 fo r greater performance ok testTrainingCbow (gensim.test.test_word2vec.TestWord2VecModel) Test CBOW word2vec training. ... WARNING:gensim.models.word2vec:consider setting layer size to a multiple of 4 for greater performance WARNING:gensim.models.word2vec:consider setting layer size to a multiple of 4 fo r greater performance ok testTrainingCbowNegative (gensim.test.test_word2vec.TestWord2VecModel) Test CBOW (negative sampling) word2vec training. ... WARNING:gensim.models.word2 vec:consider setting layer size to a multiple of 4 for greater performance WARNING:gensim.models.word2vec:consider setting layer size to a multiple of 4 fo r greater performance ok testTrainingSgNegative (gensim.test.test_word2vec.TestWord2VecModel) Test skip-gram (negative sampling) word2vec training. ... WARNING:gensim.models. word2vec:consider setting layer size to a multiple of 4 for greater performance WARNING:gensim.models.word2vec:consider setting layer size to a multiple of 4 fo r greater performance ok testVocab (gensim.test.test_word2vec.TestWord2VecModel) Test word2vec vocabulary building. ... ok testLineSentenceWorksWithCompressedFile (gensim.test.test_word2vec.TestWord2VecS entenceIterators) Does LineSentence work with a compressed file object argument? ... ok testLineSentenceWorksWithFilename (gensim.test.test_word2vec.TestWord2VecSentenc eIterators) Does LineSentence work with a filename argument? ... ok testLineSentenceWorksWithNormalFile (gensim.test.test_word2vec.TestWord2VecSente nceIterators) Does LineSentence work with a file object argument, rather than filename? ... ok
Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 348, in testL argeMmap model = ldamulticore.LdaMulticore(self.corpus, num_topics=2) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 136, in init gamma_threshold=gamma_threshold) File "e:\windows\gensim-0.10.2\gensim\models\ldamodel.py", line 313, in init self.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x05DCF930>: it's not fou nd as gensim.models.ldamulticore.worker_e_step
Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 339, in testP ersistence model = ldamulticore.LdaMulticore(self.corpus, num_topics=2) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 136, in init gamma_threshold=gamma_threshold) File "e:\windows\gensim-0.10.2\gensim\models\ldamodel.py", line 313, in init self.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x05DCF930>: it's not fou nd as gensim.models.ldamulticore.worker_e_step
Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 320, in testT opicSeeding model.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x05DCF930>: it's not fou nd as gensim.models.ldamulticore.worker_e_step
Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 289, in testT ransform model.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x05DCF930>: it's not fou nd as gensim.models.ldamulticore.worker_e_step
Ran 140 tests in 128.791s
FAILED (errors=4)
E:\windows\gensim-0.10.2>
When I run "python setup.py test" on windows
I always face the PicklingError
FAILED
details as follows
builtins.NUMPY_SETUP = False
AttributeError : prepare(preparation_data)
' File "C:\Python27\lib\multiprocessing\forking.py", line 495, in prepare
dict' object has no attribute 'NUMPY_SETUP'
'parents_main', file, path_name, etc
File "E:\windows\gensim-0.10.2\setup.py", line 155, in
Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 348, in testL argeMmap model = ldamulticore.LdaMulticore(self.corpus, num_topics=2) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 136, in init gamma_threshold=gamma_threshold) File "e:\windows\gensim-0.10.2\gensim\models\ldamodel.py", line 313, in init self.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x049386B0>: it's not fou nd as gensim.models.ldamulticore.worker_e_step
Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 339, in testP ersistence model = ldamulticore.LdaMulticore(self.corpus, num_topics=2) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 136, in init gamma_threshold=gamma_threshold) File "e:\windows\gensim-0.10.2\gensim\models\ldamodel.py", line 313, in init self.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x049386B0>: it's not fou nd as gensim.models.ldamulticore.worker_e_step
Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 320, in testT opicSeeding model.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x049386B0>: it's not fou nd as gensim.models.ldamulticore.worker_e_step
Traceback (most recent call last): File "e:\windows\gensim-0.10.2\gensim\test\test_models.py", line 289, in testT ransform model.update(corpus) File "e:\windows\gensim-0.10.2\gensim\models\ldamulticore.py", line 213, in up date pool = Pool(self.workers, worker_e_step, (job_queue, result_queue,)) File "C:\Python27\lib\multiprocessinginit.py", line 232, in Pool return Pool(processes, initializer, initargs, maxtasksperchild) File "C:\Python27\lib\multiprocessing\pool.py", line 159, in init self._repopulate_pool() File "C:\Python27\lib\multiprocessing\pool.py", line 222, in _repopulate_pool w.start() File "C:\Python27\lib\multiprocessing\process.py", line 130, in start self._popen = Popen(self) File "C:\Python27\lib\multiprocessing\forking.py", line 277, in init dump(process_obj, to_child, HIGHEST_PROTOCOL) File "C:\Python27\lib\multiprocessing\forking.py", line 199, in dump ForkingPickler(file, protocol).dump(obj) File "C:\Python27\lib\pickle.py", line 224, in dump self.save(obj) File "C:\Python27\lib\pickle.py", line 331, in save self.save_reduce(obj=obj, *rv) File "C:\Python27\lib\pickle.py", line 419, in save_reduce save(state) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 649, in save_dict self._batch_setitems(obj.iteritems()) File "C:\Python27\lib\pickle.py", line 681, in _batch_setitems save(v) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 562, in save_tuple save(element) File "C:\Python27\lib\pickle.py", line 286, in save f(self, obj) # Call unbound method with explicit self File "C:\Python27\lib\pickle.py", line 748, in save_global (obj, module, name)) PicklingError: Can't pickle <function worker_e_step at 0x049386B0>: it's not fou nd as gensim.models.ldamulticore.worker_e_step
Ran 140 tests in 129.716s
FAILED (errors=4)
I was tried hundreds times... But something are still wrong. My system is centOS. My python version is 2.6.6 I use yum install numpy scipy
Because the network problem, I can't use "easy_install" or "pip" to get gensim. So, I down the gensim.tar.gz, and unzip it, change location, then, "sudo python setup.py install" the information as follows:
running install running bdist_egg running egg_info writing requirements to gensim.egg-info/requires.txt writing gensim.egg-info/PKG-INFO writing top-level names to gensim.egg-info/top_level.txt writing dependency_links to gensim.egg-info/dependencylinks.txt reading manifest file 'gensim.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' warning: no files found matching '.sh' under directory '.' no previously-included directories found matching 'docs/src_' writing manifest file 'gensim.egg-info/SOURCES.txt' installing library code to build/bdist.linux-x86_64/egg running install_lib running build_py creating build creating build/lib.linux-x86_64-2.6 creating build/lib.linux-x86_64-2.6/gensim copying gensim/utils.py -> build/lib.linux-x86_64-2.6/gensim copying gensim/interfaces.py -> build/lib.linux-x86_64-2.6/gensim copying gensim/matutils.py -> build/lib.linux-x86_64-2.6/gensim copying gensim/nosy.py -> build/lib.linux-x86_64-2.6/gensim copying gensim/init.py -> build/lib.linux-x86_64-2.6/gensim creating build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/ldamallet.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/tfidfmodel.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/tst.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/ldamulticore.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/test.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/lsimodel.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/dtmmodel.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/ldamodel.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/lsi_worker.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/lda_dispatcher.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/lsi_dispatcher.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/saul.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/word2vec.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/logentropy_model.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/lda_worker.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/hdpmodel.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/init.py -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/rpmodel.py -> build/lib.linux-x86_64-2.6/gensim/models creating build/lib.linux-x86_64-2.6/gensim/scripts copying gensim/scripts/make_wiki_online_lemma.py -> build/lib.linux-x86_64-2.6/gensim/scripts copying gensim/scripts/make_wiki.py -> build/lib.linux-x86_64-2.6/gensim/scripts copying gensim/scripts/make_wikicorpus.py -> build/lib.linux-x86_64-2.6/gensim/scripts copying gensim/scripts/make_wiki_lemma.py -> build/lib.linux-x86_64-2.6/gensim/scripts copying gensim/scripts/make_wiki_online.py -> build/lib.linux-x86_64-2.6/gensim/scripts copying gensim/scripts/make_wiki_online_nodebug.py -> build/lib.linux-x86_64-2.6/gensim/scripts copying gensim/scripts/init.py -> build/lib.linux-x86_64-2.6/gensim/scripts creating build/lib.linux-x86_64-2.6/gensim/parsing copying gensim/parsing/porter.py -> build/lib.linux-x86_64-2.6/gensim/parsing copying gensim/parsing/preprocessing.py -> build/lib.linux-x86_64-2.6/gensim/parsing copying gensim/parsing/init.py -> build/lib.linux-x86_64-2.6/gensim/parsing creating build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/csvcorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/indexedcorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/lowcorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/mmcorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/wikicorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/bleicorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/hashdictionary.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/malletcorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/textcorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/ucicorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/dictionary.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/svmlightcorpus.py -> build/lib.linux-x86_64-2.6/gensim/corpora copying gensim/corpora/init.py -> build/lib.linux-x86_64-2.6/gensim/corpora creating build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_corpora.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_miislita.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_word2vec.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_corpora_hashdictionary.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_lee.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_utils.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_similarities.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/index_wiki.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_models.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_big.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/svd_error.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/simspeed2.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_parsing.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/init.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/test_corpora_dictionary.py -> build/lib.linux-x86_64-2.6/gensim/test copying gensim/test/simspeed.py -> build/lib.linux-x86_64-2.6/gensim/test creating build/lib.linux-x86_64-2.6/gensim/similarities copying gensim/similarities/docsim.py -> build/lib.linux-x86_64-2.6/gensim/similarities copying gensim/similarities/init.py -> build/lib.linux-x86_64-2.6/gensim/similarities copying gensim/models/voidptr.h -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/word2vec_inner.c -> build/lib.linux-x86_64-2.6/gensim/models copying gensim/models/word2vec_inner.pyx -> build/lib.linux-x86_64-2.6/gensim/models creating build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/dtm_test -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/head500.noblanks.cor -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/head500.noblanks.cor.bz2 -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/head500.noblanks.cor_tfidf.model -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/head500.noblanks.cor_wordids.txt -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/lee.cor -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/lee_background.cor -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/miIslita.cor -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/para2para_text1.txt -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/para2para_text2.txt -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/similarities0-1.txt -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/test_corpus_ok.mm -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/test_corpus_small.mm -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.blei -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.blei.vocab -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.low -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.mallet -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.mm -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.svmlight -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.txt -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.uci -> build/lib.linux-x86_64-2.6/gensim/test/test_data copying gensim/test/test_data/testcorpus.uci.vocab -> build/lib.linux-x86_64-2.6/gensim/test/test_data running build_ext building 'gensim.models.word2vec_inner' extension creating build/temp.linux-x86_64-2.6 creating build/temp.linux-x86_64-2.6/gensim creating build/temp.linux-x86_64-2.6/gensim/models gcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -Igensim/models -I/usr/include/python2.6 -I/usr/lib64/python2.6/site-packages/numpy/core/include -c ./gensim/models/word2vec_inner.c -o build/temp.linux-x86_64-2.6/./gensim/models/word2vec_inner.o unable to execute gcc: No such file or directory command 'gcc' failed with exit status 1 an integer is required Traceback (most recent call last): File "setup.py", line 155, in
include_package_data=True,
File "/usr/lib64/python2.6/distutils/core.py", line 152, in setup
dist.run_commands()
File "/usr/lib64/python2.6/distutils/dist.py", line 975, in run_commands
self.run_command(cmd)
File "/usr/lib64/python2.6/distutils/dist.py", line 995, in run_command
cmd_obj.run()
File "build/bdist.linux-x86_64/egg/setuptools/command/install.py", line 67, in run
File "build/bdist.linux-x86_64/egg/setuptools/command/install.py", line 109, in do_egg_install
File "/usr/lib64/python2.6/distutils/cmd.py", line 333, in run_command
self.distribution.run_command(command)
File "/usr/lib64/python2.6/distutils/dist.py", line 995, in run_command
cmd_obj.run()
File "build/bdist.linux-x86_64/egg/setuptools/command/bdist_egg.py", line 161, in run
File "build/bdist.linux-x86_64/egg/setuptools/command/bdist_egg.py", line 147, in call_command
File "/usr/lib64/python2.6/distutils/cmd.py", line 333, in run_command
self.distribution.run_command(command)
File "/usr/lib64/python2.6/distutils/dist.py", line 995, in run_command
cmd_obj.run()
File "build/bdist.linux-x86_64/egg/setuptools/command/install_lib.py", line 10, in run
File "/usr/lib64/python2.6/distutils/command/install_lib.py", line 119, in build
self.run_command('build_ext')
File "/usr/lib64/python2.6/distutils/cmd.py", line 333, in run_command
self.distribution.run_command(command)
File "/usr/lib64/python2.6/distutils/dist.py", line 995, in run_command
cmd_obj.run()
File "setup.py", line 71, in run
"There was an issue with your platform configuration - see above.")
TypeError: an integer is required
Please tell me what's wrong. I'm very trouble right now. Thank a lot!