Netflix-Skunkworks / Scumblr

Web framework that allows performing periodic syncs of data sources and performing analysis on the identified results
Apache License 2.0
2.64k stars 318 forks source link

Scheduled tasks not working #225

Open ermak83 opened 6 years ago

ermak83 commented 6 years ago

Hello, I just installed scumblr on Ubuntu 14.04.5 LTS, following the wiki at https://github.com/Netflix/Scumblr/wiki/Setting-up-Scumblr-2.0-%28New-install%29. All seem fine except scheduled tasks, which do not run. When I start sidekiq I have the following output:

ubuntu@graylog:~/Scumblr$ bundle exec sidekiq
/home/ubuntu/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:458: warning: already initialized constant Readline::HISTORY /home/ubuntu/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:486: warning: already initialized constant Readline::FILENAME_COMPLETION_PROC /home/ubuntu/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:517: warning: already initialized constant Readline::USERNAME_COMPLETION_PROC /home/ubuntu/.rbenv/versions/2.3.1/lib/ruby/gems/2.3.0/gems/rb-readline-0.5.1/lib/readline.rb:523: warning: already initialized constant Readline::VERSION 2018-01-08T22:51:22.842Z 447 TID-oulshm4g8 INFO: Booting Sidekiq 4.2.10 with redis options {:url=>nil}

     m,
     `$b
.ss,  $$:         .,d$
`$$P,d$P'    .,md$P"'
 ,$$$$$bmmd$$$P^'

.d$$$$$$$$$$P' $$^' "^$$$' ____ _ _ _ _ $: ,$$: / ___|(_) __| | ___| | _(_) __ _ b :$$ _ | |/ ` |/ \ |/ / |/ ` | $$: ) | | (_| | / <| | (| | $$ |____/||_,|_||__|_, | .d$$ |_|

2018-01-08T22:51:24.279Z 447 TID-oulshm4g8 INFO: Running in ruby 2.3.1p112 (2016-04-26 revision 54768) [x86_64-linux] 2018-01-08T22:51:24.280Z 447 TID-oulshm4g8 INFO: See LICENSE and the LGPL-3.0 for licensing details. 2018-01-08T22:51:24.280Z 447 TID-oulshm4g8 INFO: Upgrade to Sidekiq Pro for more features and support: http://sidekiq.org 2018-01-08T22:51:24.282Z 447 TID-oulshm4g8 INFO: Loading Schedule 2018-01-08T22:51:24.282Z 447 TID-oulshm4g8 INFO: Schedule empty! Set Sidekiq.schedule 2018-01-08T22:51:24.282Z 447 TID-oulshm4g8 INFO: Schedules Loaded 2018-01-08T22:51:24.282Z 447 TID-oulshm4g8 INFO: Starting processing, hit Ctrl-C to stop

Why redis url is nil and why schedule is empty? Is that normal?

Thank you for the support

sbehrens commented 6 years ago

Hi @ermak83,

Just to double check, did you setup a cron job to sync the tasks? More information can be found here:

https://github.com/Netflix/Scumblr/wiki/Tasks#automatic-syncing

ermak83 commented 6 years ago

If I run (or schedule via cron) the command "rake run_tasks" they are instantly executed, but I would like to use the more granular feature "Schedule selected tasks to run every DD:HH:MM", which atm seems not working.

sbehrens commented 6 years ago

@sk3tch Have you seen any issues with this feature? I don't believe we use it currently.

sbehrens commented 6 years ago

I tried this out and it's also not working, we'll open an issue and look into a fix.