search

pythonhacker / harvestman-crawler

Automatically exported from code.google.com/p/harvestman-crawler
1 stars 3 forks source link

Running configuration sample results in Exception #35

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
What steps will reproduce the problem?
1. installed harvestman using the instructions on the wiki
2. ran: harvestman -C "C:\Temp\config-sample.xml"

What is the expected output? What do you see instead?
Loading user configuration...
Using configuration file C:\Temp\config-sample.xml...
Starting HarvestMan 2.0 alpha 1...
Copyright (C) 2004, Anand B Pillai

[2010-11-11 12:16:58,785] *** Log Started ***

[2010-11-11 12:16:58,785] Starting project pytut ...
[2010-11-11 12:16:58,815] Writing project record to crawls database...
[2010-11-11 12:16:58,924] Done.
[2010-11-11 12:16:58,924] Starting download of url 
http://docs.python.org/tutorial/index.html ...
Exception received=> (1, 'Operation not permitted')
Printing error traceback for debugging...
  File "c:\python25\lib\site-packages\HarvestMan-2.0.4betadev_r256-py2.5.egg\harvestman\apps\spider.py", line 480, in run_projects
    self.run_project()
  File "c:\python25\lib\site-packages\HarvestMan-2.0.4betadev_r256-py2.5.egg\harvestman\apps\spider.py", line 518, in run_project
    self.start_project()
  File "c:\python25\lib\site-packages\HarvestMan-2.0.4betadev_r256-py2.5.egg\harvestman\apps\spider.py", line 286, in start_project
    objects.datamgr.initialize()
  File "c:\python25\lib\site-packages\HarvestMan-2.0.4betadev_r256-py2.5.egg\harvestman\lib\datamgr.py", line 144, in initialize
    self.collections.set_auto(2)
  File "c:\python25\lib\site-packages\HarvestMan-2.0.4betadev_r256-py2.5.egg\harvestman\lib\common\bst.py", line 478, in set_auto
    self.diskcache = bsddb.btopen('cache.db','n')              # DictCache(10, self.bdir)
  File "C:\Python25\lib\bsddb\__init__.py", line 327, in btopen
    d.open(file, db.DB_BTREE, flags, mode)
[2010-11-11 12:16:59,003] Shutting down logging...
HarvestMan session finished.

What version of the product are you using? On what operating system?
HarvestMan-2.0.4betadev (svn trunk for HarvestMan-lite)
OS: Windows XP (2002, service pack 3)

Please provide any additional information below.

Original issue reported on code.google.com by mattmccl...@gmail.com on 11 Nov 2010 at 6:21

GoogleCodeExporter commented 9 years ago 
I just located an earlier distribution of the same release code and it works on 
my system. It's still 2.0.4betadev, but it installs in 
"HarvestMan-2.0.4betadev-py2.5.egg" instead of 
"HarvestMan-2.0.4betadev_r256-py2.5.egg" in site-packages. Anyway, it seems 
like my error was caused by a bug in the current code in svn.

Original comment by mattmccl...@gmail.com on 12 Nov 2010 at 7:34