niqdev / packtpub-crawler

Download your daily free Packt Publishing eBook https://www.packtpub.com/packt/offers/free-learning
MIT License
755 stars 178 forks source link

Heroku Scheduler instructions #69

Closed brechtm closed 7 years ago

brechtm commented 7 years ago

It makes sense to use the Heroku Scheduler add-on as it requires much less dyno hours since it doesn't run continuously like the clock. The README is not clear on how to use the add-on however. Some questions:

niqdev commented 7 years ago

Hi, actually I suggest you to just follow the commands, you don't need to setup any add-on manually (as far as I remember).

The command heroku ps:scale clock=1 will start the scheduler for you and internally what runs is scheduler.py

I think the missing execution is referred to high frequency scheduler, I never encounter any issue on this.

If you want change the scheduler time you need to change the file that I linked above manually, and yes, every time is run it will claim again the book, upload a new copy and send a new notification.

I hope I've answered to your question. Thanks

brechtm commented 7 years ago

I think you are confused about Heroku Scheduler. Following the commands sets up a clock app which runs 24/7 and thus leaves the free dyno unavailable for other things. It is not using the Heroku Scheduler by default.

I have now set up the Heroku Scheduler add-on as described here and set it to run python script/spider.py (+ options) once daily. This occupies the free dyno only a couple of minutes each day. The only drawback is that the scheduler occasionally (but rarely) fails to trigger, so I could miss out on a book.

niqdev commented 7 years ago

Yep, I got it now, thanks. If you want feel free to update the readme with your configuration then.