Failed to waitpid - Githubissues

cnshot commented 13 years ago

2011-04-12 03:42:20,573 - lts - WARNING - Child exited ... 2011-04-12 03:42:20,575 - lts - WARNING - Testing child 0: 20468 2011-04-12 03:42:20,575 - lts - WARNING - Testing child 1: 19622 2011-04-12 03:42:20,575 - lts - WARNING - Child 1 Shot1 exited: 19622 9 2011-04-12 03:42:20,581 - lts - WARNING - Child exited ... 2011-04-12 03:42:20,580 - lts - WARNING - Child exited ... 2011-04-12 03:42:20,581 - lts - WARNING - Testing child 0: 20468 2011-04-12 03:42:20,581 - lts - WARNING - Testing child 0: 20468 2011-04-12 03:42:20,581 - lts - WARNING - Child 0 Shot0 exited: 20468 9 2011-04-12 03:42:20,581 - lts - WARNING - Failed to waitpid: 20468 [Errno 10] No child processes 2011-04-12 03:42:20,581 - lts - WARNING - Child 0 Shot0 exited: 20468 0 2011-04-12 03:42:20,584 - lts - WARNING - Testing child 1: 19622 2011-04-12 03:42:20,584 - lts - WARNING - Testing child 1: 19622 2011-04-12 03:42:20,584 - lts - WARNING - Failed to waitpid: 19622 [Errno 10] No child processes 2011-04-12 03:42:20,584 - lts - WARNING - Failed to waitpid: 19622 [Errno 10] No child processes 2011-04-12 03:42:20,584 - lts - WARNING - Child 1 Shot1 exited: 19622 0 2011-04-12 03:42:20,584 - lts - WARNING - Child 1 Shot1 exited: 19622 0 2011-04-12 03:42:20,591 - lts - WARNING - Testing child 2: 3945 2011-04-12 03:42:20,591 - lts - WARNING - Testing child 2: 3945 2011-04-12 03:42:20,591 - lts - WARNING - Child 2 Shot2 exited: 3945 9 2011-04-12 03:42:20,591 - lts - WARNING - Failed to waitpid: 3945 [Errno 10] No child processes 2011-04-12 03:42:20,591 - lts - WARNING - Child 2 Shot2 exited: 3945 0 2011-04-12 03:42:20,595 - lts - WARNING - Testing child 3: 20261 2011-04-12 03:42:20,595 - lts - WARNING - Child 3 Shot3 exited: 20261 9 2011-04-12 03:42:20,595 - lts - WARNING - Testing child 3: 20261 2011-04-12 03:42:20,596 - lts - WARNING - Failed to waitpid: 20261 [Errno 10] No child processes 2011-04-12 03:42:20,596 - lts - WARNING - Child 3 Shot3 exited: 20261 0 2011-04-12 03:42:20,602 - lts - WARNING - Testing child 4: 20472 2011-04-12 03:42:20,602 - lts - WARNING - Testing child 4: 20472 2011-04-12 03:42:20,602 - lts - WARNING - Testing child 5: 20474 2011-04-12 03:42:20,602 - lts - WARNING - Failed to waitpid: 20472 [Errno 10] No child processes 2011-04-12 03:42:20,602 - lts - WARNING - Child 5 RTShot exited: 20474 9 2011-04-12 03:42:20,602 - lts - WARNING - Child 4 URLProcessor exited: 20472 0 2011-04-12 03:42:20,605 - lts - WARNING - Testing child 6: 20475 2011-04-12 03:42:20,606 - lts - WARNING - Testing child 2: 23864 2011-04-12 03:42:20,606 - lts - WARNING - Testing child 3: 23866 2011-04-12 03:42:20,606 - lts - WARNING - Testing child 4: 20472 2011-04-12 03:42:20,606 - lts - WARNING - Testing child 5: 23868 2011-04-12 03:42:20,606 - lts - WARNING - Testing child 6: 20475 2011-04-12 03:42:20,609 - lts - WARNING - Testing child 5: 20474 2011-04-12 03:42:20,609 - lts - WARNING - Failed to waitpid: 20474 [Errno 10] No child processes 2011-04-12 03:42:20,610 - lts - WARNING - Child 5 RTShot exited: 20474 0 2011-04-12 03:42:20,615 - lts - WARNING - Testing child 6: 20475 2011-04-12 03:42:20,617 - lts - WARNING - Failed to waitpid: 20475 [Errno 10] No child processes 2011-04-12 03:42:20,617 - lts - WARNING - Child 6 TaskGC exited: 20475 0

cnshot commented 13 years ago

2011-04-12 03:42:20,581 - lts - WARNING - Child exited ... 2011-04-12 03:42:20,580 - lts - WARNING - Child exited ... 2011-04-12 03:42:20,581 - lts - WARNING - Testing child 0: 20468 2011-04-12 03:42:20,581 - lts - WARNING - Testing child 0: 20468 2011-04-12 03:42:20,581 - lts - WARNING - Child 0 Shot0 exited: 20468 9

Duplicated "Test child 0", 2 management processes?

cnshot commented 13 years ago

2011-04-12 03:42:20,573 - lts - WARNING - Child exited ... 2011-04-12 03:42:20,575 - lts - WARNING - Testing child 0: 20468 2011-04-12 03:42:20,575 - lts - WARNING - Testing child 1: 19622 2011-04-12 03:42:20,575 - lts - WARNING - Child 1 Shot1 exited: 19622 9 2011-04-12 03:42:20,581 - lts - WARNING - Child exited ...

More SIGCHLD signals during testing child process.

cnshot commented 13 years ago

Fixed in 9da162764be8d1f7d2ee4a674d9bb9aec0f0e67b

Tips:

Reconnect Django database in forked child process:

from django.db import connection
connection.close()

Use os.waitpid(0, os.WNOHANG) instead of os.waitpid(pid, os.WNOHANG)

  try:
      self.logger.debug("Waitpid ...")
      done_pid, exit_status = os.waitpid(0, os.WNOHANG)
  except OSError,e:
      self.logger.warn("waitpid() failed: %s", str(e))

  if done_pid <= 0:
      self.logger.debug("No more exited child was found.")
      return

  exited_worker_indexs = filter(lambda i: self.workers[i].pid == done_pid,
                                range(len(self.workers)))

Don't lock in signal handlers

cnshot / CNShot

Failed to waitpid #6