kostya / eye

Process monitoring tool. Inspired from Bluepill and God.
MIT License
1.19k stars 89 forks source link

Exception: attempted to call a dead actor: proc_cpu/proc_memory #221

Closed maxwxzheng closed 6 years ago

maxwxzheng commented 6 years ago

Hi! We are using eye to monitor our ruby sidekiq jobs. We are seeing the following error when bringing up the jobs. We are also seeing the same issue with proc_memory. I'm not sure how to investigate this issue. Could anyone help? Thanks!

ERROR -- [leadgenie:sidekiq_processor:sidekiq_processor_9] Exception: attempted to call a dead actor: proc_cpu ["/home/ubuntu/leadgenie/shared/bundle/ruby/2.5.0/gems/celluloid-0.17.3/lib/celluloid/proxy/sync.rb:9:in method_missing'", "/home/ubuntu/leadgenie/shared/bundle/ruby/2.5.0/gems/eye-0.10.0/lib/eye/system_resources.rb:26:instart_time'", "/home/ubuntu/leadgenie/shared/bundle/ruby/2.5.0/gems/eye-0.10.0/lib/eye/process/system.rb:44:in compare_identity'", "/home/ubuntu/leadgenie/shared/bundle/ruby/2.5.0/gems/eye-0.10.0/lib/eye/process/monitor.rb:14:inload_external_pid_file'", "/home/ubuntu/leadgenie/shared/bundle/ruby/2.5.0/gems/eye-0.10.0/lib/eye/process/controller.rb:7:in start'", "/home/ubuntu/leadgenie/shared/bundle/ruby/2.5.0/gems/eye-0.10.0/lib/eye/process/scheduler.rb:74:inscheduler_consume'", "/home/ubuntu/leadgenie/shared/bundle/ruby/2.5.0/gems/eye-0.10.0/lib/eye/process/scheduler.rb:126:in scheduler_run'", "/home/ubuntu/leadgenie/shared/bundle/ruby/2.5.0/gems/celluloid-0.17.3/lib/celluloid/calls.rb:28:inpublic_send'", "/home/ubuntu/leadgenie/shared/bundle/ruby/2.5.0/gems/celluloid-0.17.3/lib/celluloid/calls.rb:28:in dispatch'", "/home/ubuntu/leadgenie/shared/bundle/ruby/2.5.0/gems/celluloid-0.17.3/lib/celluloid/call/async.rb:7:indispatch'", "/home/ubuntu/leadgenie/shared/bundle/ruby/2.5.0/gems/celluloid-0.17.3/lib/celluloid/cell.rb:50:in block in dispatch'", "/home/ubuntu/leadgenie/shared/bundle/ruby/2.5.0/gems/celluloid-0.17.3/lib/celluloid/cell.rb:76:inblock in task'", "/home/ubuntu/leadgenie/shared/bundle/ruby/2.5.0/gems/celluloid-0.17.3/lib/celluloid/actor.rb:339:in block in task'", "/home/ubuntu/leadgenie/shared/bundle/ruby/2.5.0/gems/celluloid-0.17.3/lib/celluloid/task.rb:44:inblock in initialize'", "/home/ubuntu/leadgenie/shared/bundle/ruby/2.5.0/gems/celluloid-0.17.3/lib/celluloid/task/fibered.rb:14:in `block in create'"]

kostya commented 6 years ago

this is quite strange, is it reprodusable? this should not happen. if you quit eye and start again?

maxwxzheng commented 6 years ago

I restarted my server and can't reproduce it anymore. Closing it for now.