search

rr- / malgraph4

MALgraph: statistics service for MyAnimeList.net users.
http://mal.oko.im
Other
158 stars 39 forks source link

Zombie processes #119

Closed rr- closed 10 years ago

rr- commented 11 years ago

I came home just to find that queue process execution is blocked due to frozen cron job.

Investigate why it froze and think of way to prevent it from happening in the future.

rr- commented 11 years ago

Before I posted this issue I already have killed the process and even thoughtlessly emptied the log. Unable to do anything until it happens again.

rr- commented 10 years ago

It just happened again. Here's dump. It tries to process something in an infinite loop.

[2013-09-12 21:06:01|54df] Working
[2013-09-12 21:06:01|54df] Processing anime #12113... too soon
...
[2013-09-12 21:06:14|54df] Processing anime #18857... too soon
[2013-09-12 21:06:14|54df] Processing anime #19251... ok
[2013-09-12 21:06:20|54df] Processing anime #20159... too soon
[2013-09-12 21:06:20|54df] Processing manga #11... too soon
...
[2013-09-12 21:06:20|54df] Processing manga #23390... too soon
[2013-09-12 21:06:20|54df] Processing manga #25112... too soon
[2013-09-12 21:06:20|54df] Processing manga #26373... too soon
[2013-09-12 21:06:20|54df] Processing manga #27629... too soon
[2013-09-12 21:06:20|54df] Processing manga #32171... too soon
[2013-09-12 21:06:20|54df] Processing manga #34011... error
[2013-09-12 21:06:25|54df] exception 'BadDocumentNodeException' with message 'Bad document node (title, value: "") in http://myanimelist.net/manga/34011' in /srv/www/mal-dev/src/Processors/SubProcessors/MediaSubProcessorBasic.php:17
Stack trace:
#0 /srv/www/mal-dev/src/Processors/AbstractProcessor.php(80): MediaSubProcessorBasic->process(Array, Object(ProcessingContext))
#1 [internal function]: AbstractProcessor->{closure}()
#2 /srv/www/mal-dev/lib/redbean/RedBean/Facade.php(195): call_user_func(Object(Closure))
#3 /srv/www/mal-dev/src/Processors/AbstractProcessor.php(91): RedBean_Facade::transaction(Object(Closure))
#4 /srv/www/mal-dev/cron-queue.php(115): AbstractProcessor->process(34011)
#5 /srv/www/mal-dev/cron-queue.php(17): {closure}('M34011')
#6 /srv/www/mal-dev/cron-queue.php(119): processQueue(Object(Queue), 5, Object(Logger), Object(Closure))
#7 /srv/www/mal-dev/src/CronRunner.php(25): {closure}(Object(Logger))
#8 /srv/www/mal-dev/cron-queue.php(120): CronRunner::run('/srv/www/mal-de...', Object(Closure))
#9 {main}

...

[2013-09-13 13:05:51|54df] Processing manga #34011... error
[2013-09-13 13:05:52|54df] exception 'BadDocumentNodeException' with message 'Bad document node (title, value: "") in http://myanimelist.net/manga/34011' in /srv/www/mal-dev/src/Processors/SubProcessors/MediaSubProcessorBasic.php:17
Stack trace:
#0 /srv/www/mal-dev/src/Processors/AbstractProcessor.php(80): MediaSubProcessorBasic->process(Array, Object(ProcessingContext))
#1 [internal function]: AbstractProcessor->{closure}()
#2 /srv/www/mal-dev/lib/redbean/RedBean/Facade.php(195): call_user_func(Object(Closure))
#3 /srv/www/mal-dev/src/Processors/AbstractProcessor.php(91): RedBean_Facade::transaction(Object(Closure))
#4 /srv/www/mal-dev/cron-queue.php(115): AbstractProcessor->process(34011)
#5 /srv/www/mal-dev/cron-queue.php(17): {closure}('M34011')
#6 /srv/www/mal-dev/cron-queue.php(119): processQueue(Object(Queue), 5, Object(Logger), Object(Closure))
#7 /srv/www/mal-dev/src/CronRunner.php(25): {closure}(Object(Logger))
#8 /srv/www/mal-dev/cron-queue.php(120): CronRunner::run('/srv/www/mal-de...', Object(Closure))
#9 {main}
[2013-09-13 13:05:52|54df] Processing manga #34011...
rr- commented 10 years ago

Closing; will reopen when happens again