Closed trancen closed 7 years ago
There were some issues with relative paths in cron: https://github.com/niqdev/packtpub-crawler/pull/36/commits/ce03d4fc5cb14bd8f36671db81d6d443c2fc6324
Please try using relative paths (--config config/prod.cfg). You can also look at the readme file for working examples.
@trancen using relatives path solves your problem? Thanks
Ya it did.. I had to use the following on my crontab
cd /home/david/packtpub-crawler/ && python script/spider.py --config config/prod.cfg -t pdf --extras
Updated to the latest version.
I have the following in a crontab, been using this for a few weeks working correctly. I noticed that I wasn't getting any new books so I ran the commend manually :
python /home/david/packtpub-crawler/script/spider.py --config /home/david/packtpub-crawler/config/prod.cfg -t pdf --extras
But I'm getting the following error.
But if I move to the packtpub-crawler directory it works:
david@server:~/packtpub-crawler$ python script/spider.py --config config/prod.cfg -t pdf --extras