search

ros-infrastructure / buildfarm

Build scripts and notes for catkin debian build pipeline.
6 stars 15 forks source link

subprocess reaper is not working #130

Closed tfoote closed 11 years ago

tfoote commented 11 years ago

I found this poor executor

USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         2  0.0  0.0      0     0 ?        S    Jun24   0:00 [kthreadd]
root         3  0.0  0.0      0     0 ?        S    Jun24   9:35  \_ [ksoftirqd/0]
root         6  0.0  0.0      0     0 ?        S    Jun24   0:00  \_ [migration/0]
root         7  0.0  0.0      0     0 ?        S    Jun24   0:04  \_ [watchdog/0]
root         8  0.0  0.0      0     0 ?        S<   Jun24   0:00  \_ [cpuset]
root         9  0.0  0.0      0     0 ?        S<   Jun24   0:00  \_ [khelper]
root        10  0.0  0.0      0     0 ?        S    Jun24   0:00  \_ [kdevtmpfs]
root        11  0.0  0.0      0     0 ?        S<   Jun24   0:00  \_ [netns]
root        12  0.0  0.0      0     0 ?        S    Jun24   0:01  \_ [sync_supers]
root        13  0.0  0.0      0     0 ?        S    Jun24   0:00  \_ [bdi-default]
root        14  0.0  0.0      0     0 ?        S<   Jun24   0:00  \_ [kintegrityd]
root        15  0.0  0.0      0     0 ?        S<   Jun24   0:00  \_ [kblockd]
root        16  0.0  0.0      0     0 ?        S<   Jun24   0:00  \_ [ata_sff]
root        17  0.0  0.0      0     0 ?        S    Jun24   0:00  \_ [khubd]
root        18  0.0  0.0      0     0 ?        S<   Jun24   0:00  \_ [md]
root        20  0.0  0.0      0     0 ?        S    Jun24   0:00  \_ [kworker/u:1]
root        22  0.0  0.0      0     0 ?        S    Jun24   0:00  \_ [khungtaskd]
root        23  0.1  0.0      0     0 ?        D    Jun24  24:48  \_ [kswapd0]
root        24  0.0  0.0      0     0 ?        SN   Jun24   0:00  \_ [ksmd]
root        25  0.0  0.0      0     0 ?        SN   Jun24   0:00  \_ [khugepaged]
root        26  0.0  0.0      0     0 ?        S    Jun24   0:00  \_ [fsnotify_mark]
root        27  0.0  0.0      0     0 ?        S    Jun24   0:00  \_ [ecryptfs-kthrea]
root        28  0.0  0.0      0     0 ?        S<   Jun24   0:00  \_ [crypto]
root        36  0.0  0.0      0     0 ?        S<   Jun24   0:00  \_ [kthrotld]
root        37  0.0  0.0      0     0 ?        S    Jun24   0:00  \_ [scsi_eh_0]
root        38  0.0  0.0      0     0 ?        S    Jun24   0:00  \_ [scsi_eh_1]
root        39  0.0  0.0      0     0 ?        S    Jun24   0:00  \_ [kworker/u:2]
root        59  0.0  0.0      0     0 ?        S<   Jun24   0:00  \_ [devfreq_wq]
root       221  0.1  0.0      0     0 ?        S    Jun24  39:04  \_ [kjournald]
root       459  0.0  0.0      0     0 ?        S    Jun24   0:00  \_ [vballoon]
root       485  0.0  0.0      0     0 ?        S<   Jun24   0:00  \_ [kpsmoused]
root       614  0.0  0.0      0     0 ?        S    Jun24   0:00  \_ [kjournald]
root       926  0.0  0.0      0     0 ?        S    Jun24  15:41  \_ [flush-253:0]
root     11946  0.0  0.0      0     0 ?        S    Jun25   0:00  \_ [kauditd]
root      8040  0.0  0.0      0     0 ?        S    Jul10   0:01  \_ [kworker/0:0]
root     20595  0.0  0.0      0     0 ?        S    Jul10   0:00  \_ [kworker/0:2]
root       824  0.0  0.0      0     0 ?        S    Jul10   0:00  \_ [kworker/0:1]
root         1  0.0  0.0  24580   916 ?        Ss   Jun24   0:10 /sbin/init
root       315  0.0  0.0  17364     0 ?        S    Jun24   0:00 upstart-udev-bridge --daemon
root       317  0.0  0.0  22076     4 ?        Ss   Jun24   0:00 /sbin/udevd --daemon
root       344  0.0  0.0  22072     8 ?        S    Jun24   0:00  \_ /sbin/udevd --daemon
root       345  0.0  0.0  22072     4 ?        S    Jun24   0:00  \_ /sbin/udevd --daemon
root       518  0.0  0.0  15188     0 ?        S    Jun24   0:00 upstart-socket-bridge --daemon
root       656  0.0  0.0  50032   172 ?        Ss   Jun24   0:00 /usr/sbin/sshd -D
root     21218  0.0  0.0  92300     8 ?        Ss   Jul03   0:00  \_ sshd: rosbuild [priv]
rosbuild 21362  0.0  0.0  93224   236 ?        S    Jul03   7:53  |   \_ sshd: rosbuild@notty
rosbuild 21376  0.0  0.0  12296     0 ?        Ss   Jul03   0:00  |       \_ bash -c cd '/home/rosbuild/hudson' && java  -jar slave.jar
rosbuild 21377  0.1  2.3 1579256 40880 ?       Sl   Jul03  10:47  |           \_ java -jar slave.jar
rosbuild 27965  0.0  0.0  12324  1208 ?        S    00:07   0:00  |               \_ /bin/bash -x /tmp/hudson6873334406633270760.sh
root     28070  0.0  0.1  55852  1876 ?        S    00:08   0:00  |                   \_ sudo pbuilder --update --basetgz /var/cache/pbuilder-precise-i386/base-6.tgz
root     28071  0.0  0.0  12356  1460 ?        S    00:08   0:00  |                       \_ /bin/bash /usr/sbin/pbuilder --update --basetgz /var/cache/pbuilder-precise-i386/base-6.tgz
root     28072  0.0  0.0  12548  1748 ?        S    00:08   0:00  |                           \_ /bin/bash /usr/lib/pbuilder/pbuilder-updatebuildenv --basetgz /var/cache/pbuilder-precise-i386/base-6.tgz
root     28081  0.0  0.0  12548   860 ?        S    00:08   0:00  |                               \_ /bin/bash /usr/lib/pbuilder/pbuilder-updatebuildenv --basetgz /var/cache/pbuilder-precise-i386/base-6.tgz
root     28082  3.5  0.0  17396  1184 ?        D    00:08   0:00  |                                   \_ tar -x --use-compress-program gzip -p -f /var/cache/pbuilder-precise-i386/base-6.tgz
root     28083  8.0  0.0   8940   668 ?        S    00:08   0:00  |                                       \_ gzip -d
root     22568  0.0  0.1  90240  1764 ?        Ss   00:05   0:00  \_ sshd: root@pts/3    
root     27780  0.0  0.2  24052  4580 pts/3    Ss   00:05   0:00      \_ -bash
root     28084  0.0  0.0  18444  1284 pts/3    R+   00:08   0:00          \_ ps auxf
root     28085  0.0  0.0   7180   360 pts/3    S+   00:08   0:00          \_ cat
syslog     667  0.0  0.0 249860   148 ?        Sl   Jun24   0:34 rsyslogd -c5
102        774  0.0  0.0  24228   540 ?        Ss   Jun24   0:00 dbus-daemon --system --fork --activation=upstart
root       840  0.0  0.0  15784     8 tty4     Ss+  Jun24   0:00 /sbin/getty -8 38400 tty4
root       845  0.0  0.0  15784     8 tty5     Ss+  Jun24   0:00 /sbin/getty -8 38400 tty5
root       851  0.0  0.0  15784     8 tty2     Ss+  Jun24   0:00 /sbin/getty -8 38400 tty2
root       852  0.0  0.0  15784     8 tty3     Ss+  Jun24   0:00 /sbin/getty -8 38400 tty3
root       854  0.0  0.0  15784     8 tty6     Ss+  Jun24   0:00 /sbin/getty -8 38400 tty6
root       855  0.0  0.0  18052     0 ttyS0    Ss+  Jun24   0:00 /bin/bash
root       860  0.0  0.0   4328     0 ?        Ss   Jun24   0:00 acpid -c /etc/acpi/events -s /var/run/acpid.socket
root       863  0.0  0.0  19112   104 ?        Ss   Jun24   0:01 cron
daemon     864  0.0  0.0  16908     0 ?        Ss   Jun24   0:00 atd
whoopsie   888  0.0  0.0 187660   560 ?        Ssl  Jun24   0:12 whoopsie
systuser   890  0.0  0.5  94128  8756 ?        S    Jun24   5:14 SonarPush 0.4.0 [sleeping]            
root       922  0.0  0.0  15784     8 tty1     Ss+  Jun24   0:00 /sbin/getty -8 38400 tty1
systuser   925  0.0  0.5  95960  9200 ?        S    Jun24   5:19 SonarPush 0.4.0 [sleeping]            
ntp       5830  0.0  0.0  37772   372 ?        Ss   Jun24   0:51 /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 107:114
avahi    31760  0.0  0.0  32324   220 ?        S    Jun24   0:06 avahi-daemon: running [host05.local]
avahi    31761  0.0  0.0  32180     4 ?        S    Jun24   0:00  \_ avahi-daemon: chroot helper
root     32172  0.0  0.0  79040   288 ?        Ss   Jun24   0:00 /usr/sbin/modem-manager
root       356  0.0  0.0 104056    52 ?        Ss   Jun24   0:00 /usr/sbin/cupsd -F
root      2763  0.0  0.0 128384   212 ?        Ssl  Jun24   0:00 gdm-binary
root      2799  0.0  0.0 129604     0 ?        Sl   Jun24   0:00  \_ /usr/lib/gdm/gdm-simple-slave --display-id /org/gnome/DisplayManager/Display2
root      2801  0.0  0.0  66340     0 tty8     Ss+  Jun24   0:00      \_ /usr/bin/Xorg :1 -br -verbose -auth /var/run/gdm/auth-for-gdm-FF1wCD/database -nolisten tcp
root      2812  0.0  0.4 179776  8280 ?        Ss   Jun24  14:59 /usr/bin/ruby1.8 /usr/bin/puppet agent
root      3057  0.0  0.0 584304   284 ?        Sl   Jun24   0:00 /usr/sbin/console-kit-daemon --no-daemon
root      3124  0.0  0.0 186592   532 ?        Sl   Jun24   0:00 /usr/lib/policykit-1/polkitd --no-debug
proxy     8291  0.0  0.9 365968 16732 ?        Ss   Jun27   7:19 /usr/sbin/squid3 -N -YC -f /etc/squid3/squid.conf
proxy     8292  0.0  0.0  12428     0 ?        Ss   Jun27   0:02  \_ (unlinkd)
root     14030  0.0  0.0  12580     4 ?        S    Jul03   0:00 /bin/bash /usr/lib/pbuilder/pbuilder-buildpackage --basetgz /var/cache/pbuilder-quantal-amd64/base-6.tgz --buildresult /home/rosbuild/hudson/workspace/ros-hydro-diagnostic-aggregator_binarydeb_quantal_amd64/output --debbuildopts "-b" --hookdir hooks ros-hydro-diagnostic-aggregator_1.8.0-0quantal.dsc
root     15812  0.0  0.0  12580     4 ?        S    Jul03   0:00  \_ /bin/bash /usr/lib/pbuilder/pbuilder-buildpackage --basetgz /var/cache/pbuilder-quantal-amd64/base-6.tgz --buildresult /home/rosbuild/hudson/workspace/ros-hydro-diagnostic-aggregator_binarydeb_quantal_amd64/output --debbuildopts "-b" --hookdir hooks ros-hydro-diagnostic-aggregator_1.8.0-0quantal.dsc
1234     15814  0.0  0.0  37952     0 ?        S    Jul03   0:00      \_ su -p pbuilder
1234     15815  0.0  0.0   9420     4 ?        S    Jul03   0:00          \_ bash
1234     15816  0.0  0.0  30640     8 ?        S    Jul03   0:00              \_ /usr/bin/perl /usr/bin/dpkg-buildpackage -us -uc -b -rfakeroot
1234     15869  0.0  0.0   8700     0 ?        S    Jul03   0:00                  \_ /usr/bin/make -f debian/rules build
1234     15870  0.0  0.0  21960     8 ?        S    Jul03   0:00                      \_ /usr/bin/perl -w /usr/bin/dh build
1234     16263  0.0  0.0   8696     0 ?        S    Jul03   0:00                          \_ /usr/bin/make -f debian/rules override_dh_auto_test
1234     16268  0.0  0.0   4392     4 ?        S    Jul03   0:00                              \_ /bin/sh -c if [ -f "/opt/ros/hydro/setup.sh" ]; then . "/opt/ros/hydro/setup.sh"; fi && \?dh_auto_test || true
1234     16278  0.0  0.0  24432     4 ?        S    Jul03   0:00                                  \_ /usr/bin/perl -w /usr/bin/dh_auto_test
1234     16284  0.0  0.0   8828     0 ?        S    Jul03   0:00                                      \_ make -j1 test ARGS+=-j1
1234     16287  0.0  0.0 130396    36 ?        S    Jul03   1:28                                          \_ /usr/bin/ctest --force-new-ctest-process -j1
1234     16427  0.0  0.0  25220     8 ?        S    Jul03   0:00                                              \_ /usr/bin/python /opt/ros/hydro/share/catkin/cmake/test/run_tests.py /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0quantal-20130704-0217/obj-x86_64-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml --return-code /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0quantal-20130704-0217/obj-x86_64-linux-gnu/devel/lib/diagnostic_aggregator/analyzer_loader --gtest_output=xml:/tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0quantal-20130704-0217/obj-x86_64-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml
1234     16428  0.0  0.0   4392     0 ?        S    Jul03   0:00                                                  \_ /bin/sh -c /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0quantal-20130704-0217/obj-x86_64-linux-gnu/devel/lib/diagnostic_aggregator/analyzer_loader --gtest_output=xml:/tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0quantal-20130704-0217/obj-x86_64-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml
1234     16429  0.3  0.0 326900   956 ?        Sl   Jul03  32:34                                                      \_ /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0quantal-20130704-0217/obj-x86_64-linux-gnu/devel/lib/diagnostic_aggregator/analyzer_loader --gtest_output=xml:/tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0quantal-20130704-0217/obj-x86_64-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml
root     12435  0.0  0.0  12580     4 ?        S    Jul04   0:00 /bin/bash /usr/lib/pbuilder/pbuilder-buildpackage --basetgz /var/cache/pbuilder-quantal-amd64/base-6.tgz --buildresult /home/rosbuild/hudson/workspace/ros-hydro-diagnostic-aggregator_binarydeb_quantal_amd64/output --debbuildopts "-b" --hookdir hooks ros-hydro-diagnostic-aggregator_1.8.0-0quantal.dsc
root     14658  0.0  0.0  12580     4 ?        S    Jul04   0:00  \_ /bin/bash /usr/lib/pbuilder/pbuilder-buildpackage --basetgz /var/cache/pbuilder-quantal-amd64/base-6.tgz --buildresult /home/rosbuild/hudson/workspace/ros-hydro-diagnostic-aggregator_binarydeb_quantal_amd64/output --debbuildopts "-b" --hookdir hooks ros-hydro-diagnostic-aggregator_1.8.0-0quantal.dsc
1234     14660  0.0  0.0  37952     0 ?        S    Jul04   0:00      \_ su -p pbuilder
1234     14661  0.0  0.0   9420     4 ?        S    Jul04   0:00          \_ bash
1234     14662  0.0  0.0  30640     8 ?        S    Jul04   0:00              \_ /usr/bin/perl /usr/bin/dpkg-buildpackage -us -uc -b -rfakeroot
1234     14715  0.0  0.0   8700     0 ?        S    Jul04   0:00                  \_ /usr/bin/make -f debian/rules build
1234     14716  0.0  0.0  21960     8 ?        S    Jul04   0:00                      \_ /usr/bin/perl -w /usr/bin/dh build
1234     15098  0.0  0.0   8696     0 ?        S    Jul04   0:00                          \_ /usr/bin/make -f debian/rules override_dh_auto_test
1234     15103  0.0  0.0   4392     4 ?        S    Jul04   0:00                              \_ /bin/sh -c if [ -f "/opt/ros/hydro/setup.sh" ]; then . "/opt/ros/hydro/setup.sh"; fi && \?dh_auto_test || true
1234     15113  0.0  0.0  24432     4 ?        S    Jul04   0:00                                  \_ /usr/bin/perl -w /usr/bin/dh_auto_test
1234     15119  0.0  0.0   8828     0 ?        S    Jul04   0:00                                      \_ make -j1 test ARGS+=-j1
1234     15122  0.0  0.0 130396    36 ?        S    Jul04   1:23                                          \_ /usr/bin/ctest --force-new-ctest-process -j1
1234     15261  0.0  0.0  25220     8 ?        S    Jul04   0:00                                              \_ /usr/bin/python /opt/ros/hydro/share/catkin/cmake/test/run_tests.py /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0quantal-20130704-0745/obj-x86_64-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml --return-code /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0quantal-20130704-0745/obj-x86_64-linux-gnu/devel/lib/diagnostic_aggregator/analyzer_loader --gtest_output=xml:/tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0quantal-20130704-0745/obj-x86_64-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml
1234     15262  0.0  0.0   4392     0 ?        S    Jul04   0:00                                                  \_ /bin/sh -c /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0quantal-20130704-0745/obj-x86_64-linux-gnu/devel/lib/diagnostic_aggregator/analyzer_loader --gtest_output=xml:/tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0quantal-20130704-0745/obj-x86_64-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml
1234     15263  0.3  0.0 326900   812 ?        Sl   Jul04  31:16                                                      \_ /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0quantal-20130704-0745/obj-x86_64-linux-gnu/devel/lib/diagnostic_aggregator/analyzer_loader --gtest_output=xml:/tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0quantal-20130704-0745/obj-x86_64-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml
root      7932  0.0  0.0  12580     4 ?        S    Jul04   0:00 /bin/bash /usr/lib/pbuilder/pbuilder-buildpackage --basetgz /var/cache/pbuilder-raring-i386/base-6.tgz --buildresult /home/rosbuild/hudson/workspace/ros-hydro-diagnostic-aggregator_binarydeb_raring_i386/output --debbuildopts "-b" --hookdir hooks ros-hydro-diagnostic-aggregator_1.8.0-0raring.dsc
root     11732  0.0  0.0  12580     4 ?        S    Jul04   0:00  \_ /bin/bash /usr/lib/pbuilder/pbuilder-buildpackage --basetgz /var/cache/pbuilder-raring-i386/base-6.tgz --buildresult /home/rosbuild/hudson/workspace/ros-hydro-diagnostic-aggregator_binarydeb_raring_i386/output --debbuildopts "-b" --hookdir hooks ros-hydro-diagnostic-aggregator_1.8.0-0raring.dsc
root     11734  0.0  0.0   3196     0 ?        S    Jul04   0:00      \_ su -p pbuilder
1234     11735  0.0  0.0   3144     0 ?        S    Jul04   0:00          \_ bash
1234     11736  0.0  0.0   7264     8 ?        S    Jul04   0:00              \_ /usr/bin/perl /usr/bin/dpkg-buildpackage -us -uc -b -rfakeroot
1234     11789  0.0  0.0   2480     0 ?        S    Jul04   0:00                  \_ /usr/bin/make -f debian/rules build
1234     11790  0.0  0.0   5684     8 ?        S    Jul04   0:00                      \_ /usr/bin/perl -w /usr/bin/dh build
1234     12183  0.0  0.0   2480     0 ?        S    Jul04   0:00                          \_ /usr/bin/make -f debian/rules override_dh_auto_test
1234     12188  0.0  0.0   2268     8 ?        S    Jul04   0:00                              \_ /bin/sh -c if [ -f "/opt/ros/hydro/setup.sh" ]; then . "/opt/ros/hydro/setup.sh"; fi && \?dh_auto_test || true
1234     12198  0.0  0.0   5956     8 ?        S    Jul04   0:00                                  \_ /usr/bin/perl -w /usr/bin/dh_auto_test
1234     12204  0.0  0.0   2480     0 ?        S    Jul04   0:00                                      \_ make -j1 test ARGS+=-j1
1234     12207  0.0  0.0  18332    64 ?        S    Jul04   1:14                                          \_ /usr/bin/ctest --force-new-ctest-process -j1
1234     12346  0.0  0.0   8236     4 ?        S    Jul04   0:00                                              \_ /usr/bin/python /opt/ros/hydro/share/catkin/cmake/test/run_tests.py /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0raring-20130704-2310/obj-i686-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml --return-code /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0raring-20130704-2310/obj-i686-linux-gnu/devel/lib/diagnostic_aggregator/analyzer_loader --gtest_output=xml:/tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0raring-20130704-2310/obj-i686-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml
1234     12347  0.0  0.0   2268     4 ?        S    Jul04   0:00                                                  \_ /bin/sh -c /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0raring-20130704-2310/obj-i686-linux-gnu/devel/lib/diagnostic_aggregator/analyzer_loader --gtest_output=xml:/tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0raring-20130704-2310/obj-i686-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml
1234     12348  0.3  0.0  48476   968 ?        Sl   Jul04  28:35                                                      \_ /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0raring-20130704-2310/obj-i686-linux-gnu/devel/lib/diagnostic_aggregator/analyzer_loader --gtest_output=xml:/tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0raring-20130704-2310/obj-i686-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml
root      3777  0.0  0.0  12580     4 ?        S    Jul04   0:00 /bin/bash /usr/lib/pbuilder/pbuilder-buildpackage --basetgz /var/cache/pbuilder-precise-i386/base-6.tgz --buildresult /home/rosbuild/hudson/workspace/ros-hydro-diagnostic-aggregator_binarydeb_precise_i386/output --debbuildopts "-b" --hookdir hooks ros-hydro-diagnostic-aggregator_1.8.0-0precise.dsc
root     12502  0.0  0.0  12580     4 ?        S    Jul04   0:00  \_ /bin/bash /usr/lib/pbuilder/pbuilder-buildpackage --basetgz /var/cache/pbuilder-precise-i386/base-6.tgz --buildresult /home/rosbuild/hudson/workspace/ros-hydro-diagnostic-aggregator_binarydeb_precise_i386/output --debbuildopts "-b" --hookdir hooks ros-hydro-diagnostic-aggregator_1.8.0-0precise.dsc
1234     12504  0.0  0.0   3024     0 ?        S    Jul04   0:00      \_ su -p pbuilder
1234     12505  0.0  0.0   3100     0 ?        S    Jul04   0:00          \_ bash
1234     12506  0.0  0.0   7240     8 ?        S    Jul04   0:00              \_ /usr/bin/perl /usr/bin/dpkg-buildpackage -us -uc -b -rfakeroot
1234     12561  0.0  0.0   2440     0 ?        S    Jul04   0:00                  \_ /usr/bin/make -f debian/rules build
1234     12562  0.0  0.0   5532     8 ?        S    Jul04   0:00                      \_ /usr/bin/perl -w /usr/bin/dh build
1234     12945  0.0  0.0   2440     0 ?        S    Jul04   0:00                          \_ /usr/bin/make -f debian/rules override_dh_auto_test
1234     12950  0.0  0.0   2232     8 ?        S    Jul04   0:00                              \_ /bin/sh -c if [ -f "/opt/ros/hydro/setup.sh" ]; then . "/opt/ros/hydro/setup.sh"; fi && \?dh_auto_test || true
1234     12960  0.0  0.0   5816     4 ?        S    Jul04   0:00                                  \_ /usr/bin/perl -w /usr/bin/dh_auto_test
1234     12966  0.0  0.0   2440     0 ?        S    Jul04   0:00                                      \_ make -j1 test ARGS+=-j1
1234     12969  0.0  0.0  20388    36 ?        S    Jul04   1:16                                          \_ /usr/bin/ctest --force-new-ctest-process -j1
1234     13109  0.0  0.0  10012     8 ?        S    Jul04   0:00                                              \_ /usr/bin/python /opt/ros/hydro/share/catkin/cmake/test/run_tests.py /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0precise-20130704-2346/obj-i686-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml --return-code /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0precise-20130704-2346/obj-i686-linux-gnu/devel/lib/diagnostic_aggregator/analyzer_loader --gtest_output=xml:/tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0precise-20130704-2346/obj-i686-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml
1234     13110  0.0  0.0   2232     4 ?        S    Jul04   0:00                                                  \_ /bin/sh -c /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0precise-20130704-2346/obj-i686-linux-gnu/devel/lib/diagnostic_aggregator/analyzer_loader --gtest_output=xml:/tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0precise-20130704-2346/obj-i686-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml
1234     13111  0.2  0.0  46648   656 ?        Sl   Jul04  23:15                                                      \_ /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0precise-20130704-2346/obj-i686-linux-gnu/devel/lib/diagnostic_aggregator/analyzer_loader --gtest_output=xml:/tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0precise-20130704-2346/obj-i686-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml
root     18458  0.0  0.0  12580     4 ?        S    Jul05   0:00 /bin/bash /usr/lib/pbuilder/pbuilder-buildpackage --basetgz /var/cache/pbuilder-precise-amd64/base-6.tgz --buildresult /home/rosbuild/hudson/workspace/ros-hydro-diagnostic-aggregator_binarydeb_precise_amd64/output --debbuildopts "-b" --hookdir hooks ros-hydro-diagnostic-aggregator_1.8.0-0precise.dsc
root     27246  0.0  0.0  12580     4 ?        S    Jul05   0:00  \_ /bin/bash /usr/lib/pbuilder/pbuilder-buildpackage --basetgz /var/cache/pbuilder-precise-amd64/base-6.tgz --buildresult /home/rosbuild/hudson/workspace/ros-hydro-diagnostic-aggregator_binarydeb_precise_amd64/output --debbuildopts "-b" --hookdir hooks ros-hydro-diagnostic-aggregator_1.8.0-0precise.dsc
1234     27248  0.0  0.0  37952     0 ?        S    Jul05   0:00      \_ su -p pbuilder
1234     27249  0.0  0.0   9412     4 ?        S    Jul05   0:00          \_ bash
1234     27250  0.0  0.0  30944     8 ?        S    Jul05   0:00              \_ /usr/bin/perl /usr/bin/dpkg-buildpackage -us -uc -b -rfakeroot
1234     27305  0.0  0.0   8700     0 ?        S    Jul05   0:00                  \_ /usr/bin/make -f debian/rules build
1234     27306  0.0  0.0  21872     8 ?        S    Jul05   0:00                      \_ /usr/bin/perl -w /usr/bin/dh build
1234     27683  0.0  0.0   8696     0 ?        S    Jul05   0:00                          \_ /usr/bin/make -f debian/rules override_dh_auto_test
1234     27688  0.0  0.0   4396     4 ?        S    Jul05   0:00                              \_ /bin/sh -c if [ -f "/opt/ros/hydro/setup.sh" ]; then . "/opt/ros/hydro/setup.sh"; fi && \?dh_auto_test || true
1234     27698  0.0  0.0  24460     0 ?        S    Jul05   0:00                                  \_ /usr/bin/perl -w /usr/bin/dh_auto_test
1234     27704  0.0  0.0   8828     0 ?        S    Jul05   0:00                                      \_ make -j1 test ARGS+=-j1
1234     27707  0.0  0.0 130096    40 ?        S    Jul05   1:11                                          \_ /usr/bin/ctest --force-new-ctest-process -j1
1234     27846  0.0  0.0  33392     8 ?        S    Jul05   0:00                                              \_ /usr/bin/python /opt/ros/hydro/share/catkin/cmake/test/run_tests.py /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0precise-20130705-0702/obj-x86_64-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml --return-code /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0precise-20130705-0702/obj-x86_64-linux-gnu/devel/lib/diagnostic_aggregator/analyzer_loader --gtest_output=xml:/tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0precise-20130705-0702/obj-x86_64-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml
1234     27847  0.0  0.0   4396     0 ?        S    Jul05   0:00                                                  \_ /bin/sh -c /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0precise-20130705-0702/obj-x86_64-linux-gnu/devel/lib/diagnostic_aggregator/analyzer_loader --gtest_output=xml:/tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0precise-20130705-0702/obj-x86_64-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml
1234     27848  0.2  0.0 329256   684 ?        Sl   Jul05  21:54                                                      \_ /tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0precise-20130705-0702/obj-x86_64-linux-gnu/devel/lib/diagnostic_aggregator/analyzer_loader --gtest_output=xml:/tmp/buildd/ros-hydro-diagnostic-aggregator-1.8.0-0precise-20130705-0702/obj-x86_64-linux-gnu/test_results/diagnostic_aggregator/gtest-analyzer_loader.xml
root     13211  0.0  0.0  12580     4 ?        S    Jul05   0:00 /bin/bash /usr/lib/pbuilder/pbuilder-buildpackage --basetgz /var/cache/pbuilder-quantal-i386/base-6.tgz --buildresult /home/rosbuild/hudson/workspace/ros-hydro-self-test_binarydeb_quantal_i386/output --debbuildopts "-b" --hookdir hooks ros-hydro-self-test_1.8.0-0quantal.dsc
root     17121  0.0  0.0  12580     4 ?        S    Jul05   0:00  \_ /bin/bash /usr/lib/pbuilder/pbuilder-buildpackage --basetgz /var/cache/pbuilder-quantal-i386/base-6.tgz --buildresult /home/rosbuild/hudson/workspace/ros-hydro-self-test_binarydeb_quantal_i386/output --debbuildopts "-b" --hookdir hooks ros-hydro-self-test_1.8.0-0quantal.dsc
1234     17123  0.0  0.0   3028     0 ?        S    Jul05   0:00      \_ su -p pbuilder
1234     17124  0.0  0.0   3100     0 ?        S    Jul05   0:00          \_ bash
1234     17125  0.0  0.0   7120     8 ?        S    Jul05   0:00              \_ /usr/bin/perl /usr/bin/dpkg-buildpackage -us -uc -b -rfakeroot
1234     17178  0.0  0.0   2444     0 ?        S    Jul05   0:00                  \_ /usr/bin/make -f debian/rules build
1234     17179  0.0  0.0   5548     8 ?        S    Jul05   0:00                      \_ /usr/bin/perl -w /usr/bin/dh build
1234     17530  0.0  0.0   2444     0 ?        S    Jul05   0:00                          \_ /usr/bin/make -f debian/rules override_dh_auto_test
1234     17535  0.0  0.0   2232     8 ?        S    Jul05   0:00                              \_ /bin/sh -c if [ -f "/opt/ros/hydro/setup.sh" ]; then . "/opt/ros/hydro/setup.sh"; fi && \?dh_auto_test || true
1234     17545  0.0  0.0   5820     8 ?        S    Jul05   0:00                                  \_ /usr/bin/perl -w /usr/bin/dh_auto_test
1234     17551  0.0  0.0   2444     0 ?        S    Jul05   0:00                                      \_ make -j1 test ARGS+=-j1
1234     17554  0.0  0.0  20740    32 ?        S    Jul05   1:02                                          \_ /usr/bin/ctest --force-new-ctest-process -j1
1234     17555  0.0  0.0   8072     8 ?        S    Jul05   0:00                                              \_ /usr/bin/python /opt/ros/hydro/share/catkin/cmake/test/run_tests.py /tmp/buildd/ros-hydro-self-test-1.8.0-0quantal-20130705-2311/obj-i686-linux-gnu/test_results/self_test/gtest-selftest_rostest.xml --return-code /tmp/buildd/ros-hydro-self-test-1.8.0-0quantal-20130705-2311/obj-i686-linux-gnu/devel/lib/self_test/selftest_rostest --gtest_output=xml:/tmp/buildd/ros-hydro-self-test-1.8.0-0quantal-20130705-2311/obj-i686-linux-gnu/test_results/self_test/gtest-selftest_rostest.xml
1234     17556  0.0  0.0   2232     4 ?        S    Jul05   0:00                                                  \_ /bin/sh -c /tmp/buildd/ros-hydro-self-test-1.8.0-0quantal-20130705-2311/obj-i686-linux-gnu/devel/lib/self_test/selftest_rostest --gtest_output=xml:/tmp/buildd/ros-hydro-self-test-1.8.0-0quantal-20130705-2311/obj-i686-linux-gnu/test_results/self_test/gtest-selftest_rostest.xml
1234     17557  0.3  0.0  41140   856 ?        Sl   Jul05  23:33                                                      \_ /tmp/buildd/ros-hydro-self-test-1.8.0-0quantal-20130705-2311/obj-i686-linux-gnu/devel/lib/self_test/selftest_rostest --gtest_output=xml:/tmp/buildd/ros-hydro-self-test-1.8.0-0quantal-20130705-2311/obj-i686-linux-gnu/test_results/self_test/gtest-selftest_rostest.xml
root      4594  0.0  0.0  12580     4 ?        S    Jul10   0:00 /bin/bash /usr/lib/pbuilder/pbuilder-buildpackage --basetgz /var/cache/pbuilder-quantal-amd64/base-6.tgz --buildresult /home/rosbuild/hudson/workspace/ros-hydro-pcl_binarydeb_quantal_amd64/output --debbuildopts "-b" --hookdir hooks ros-hydro-pcl_1.7.0-7quantal.dsc
root     15758  0.0  0.0  12580     4 ?        S    Jul10   0:00  \_ /bin/bash /usr/lib/pbuilder/pbuilder-buildpackage --basetgz /var/cache/pbuilder-quantal-amd64/base-6.tgz --buildresult /home/rosbuild/hudson/workspace/ros-hydro-pcl_binarydeb_quantal_amd64/output --debbuildopts "-b" --hookdir hooks ros-hydro-pcl_1.7.0-7quantal.dsc
1234     15760  0.0  0.0  37952     0 ?        S    Jul10   0:00      \_ su -p pbuilder
1234     15761  0.0  0.0   9424     0 ?        S    Jul10   0:00          \_ bash
1234     15762  0.0  0.0  30640     8 ?        S    Jul10   0:00              \_ /usr/bin/perl /usr/bin/dpkg-buildpackage -us -uc -b -rfakeroot
1234     15819  0.0  0.0   8700     0 ?        S    Jul10   0:00                  \_ /usr/bin/make -f debian/rules build
1234     15820  0.0  0.0  21836     8 ?        S    Jul10   0:00                      \_ /usr/bin/perl -w /usr/bin/dh build
1234     16119  0.0  0.0   8696     0 ?        S    Jul10   0:00                          \_ /usr/bin/make -f debian/rules override_dh_auto_build
1234     16123  0.0  0.0   4392     0 ?        S    Jul10   0:00                              \_ /bin/sh -c if [ -f "/opt/ros/hydro/setup.sh" ]; then . "/opt/ros/hydro/setup.sh"; fi && \?dh_auto_build
1234     16124  0.0  0.0  24424     8 ?        S    Jul10   0:00                                  \_ /usr/bin/perl -w /usr/bin/dh_auto_build
1234     16130  0.0  0.0   8960     0 ?        S    Jul10   0:00                                      \_ make -j1
1234     16133  0.0  0.0   9484     8 ?        S    Jul10   0:00                                          \_ make -f CMakeFiles/Makefile2 all
1234     27388  0.0  0.0   9276     0 ?        S    Jul10   0:00                                              \_ make -f test/registration/CMakeFiles/test_registration.dir/build.make test/registration/CMakeFiles/test_registration.dir/build
1234     27401  0.0  0.0   4392     0 ?        S    Jul10   0:00                                                  \_ /bin/sh -c cd /tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/obj-x86_64-linux-gnu/test/registration && /usr/lib/ccache/c++   -DEIGEN_USE_NEW_STDVECTOR -DEIGEN_YES_I_KNOW_SPARSE_MODULE_IS_NOT_STABLE_YET -Dqh_QHpointer -DQT_GUI_LIB -DQT_CORE_LIB -DQT_NO_DEBUG -Wall -Wextra -Wno-unknown-pragmas -fno-strict-aliasing -Wno-format-extra-args -Wno-sign-compare -Wno-invalid-offsetof -Wno-conversion  -Wabi -pthread -fopenmp  -Wno-deprecated -O2 -g -isystem /usr/include/eigen3 -I/usr/include/qt4 -I/usr/include/qt4/QtGui -I/usr/include/qt4/QtCore -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/obj-x86_64-linux-gnu/include -I/usr/include/vtk-5.8 -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/common/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/sample_consensus/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/io/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/kdtree/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/features/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/filters/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/geometry/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/keypoints/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/search/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/surface/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/registration/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/segmentation/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/octree/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/recognition/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/people/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/outofcore/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/visualization/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/test/gtest-1.6.0/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/test/gtest-1.6.0    -DBOOST_DISABLE_ASSERTS -DEIGEN_NO_DEBUG -o CMakeFiles/test_registration.dir/test_registration.cpp.o -c /tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/test/registration/test_registration.cpp
1234     27403  0.0  0.0  10120     8 ?        S    Jul10   0:00                                                      \_ /usr/lib/ccache/c++ -DEIGEN_USE_NEW_STDVECTOR -DEIGEN_YES_I_KNOW_SPARSE_MODULE_IS_NOT_STABLE_YET -Dqh_QHpointer -DQT_GUI_LIB -DQT_CORE_LIB -DQT_NO_DEBUG -Wall -Wextra -Wno-unknown-pragmas -fno-strict-aliasing -Wno-format-extra-args -Wno-sign-compare -Wno-invalid-offsetof -Wno-conversion -Wabi -pthread -fopenmp -Wno-deprecated -O2 -g -isystem /usr/include/eigen3 -I/usr/include/qt4 -I/usr/include/qt4/QtGui -I/usr/include/qt4/QtCore -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/obj-x86_64-linux-gnu/include -I/usr/include/vtk-5.8 -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/common/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/sample_consensus/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/io/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/kdtree/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/features/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/filters/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/geometry/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/keypoints/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/search/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/surface/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/registration/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/segmentation/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/octree/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/recognition/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/people/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/outofcore/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/visualization/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/test/gtest-1.6.0/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/test/gtest-1.6.0 -DBOOST_DISABLE_ASSERTS -DEIGEN_NO_DEBUG -o CMakeFiles/test_registration.dir/test_registration.cpp.o -c /tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/test/registration/test_registration.cpp
1234     28566  0.0  0.0   4856     0 ?        S    Jul10   0:00                                                          \_ /usr/bin/c++ -DEIGEN_USE_NEW_STDVECTOR -DEIGEN_YES_I_KNOW_SPARSE_MODULE_IS_NOT_STABLE_YET -Dqh_QHpointer -DQT_GUI_LIB -DQT_CORE_LIB -DQT_NO_DEBUG -Wall -Wextra -Wno-unknown-pragmas -fno-strict-aliasing -Wno-format-extra-args -Wno-sign-compare -Wno-invalid-offsetof -Wno-conversion -Wabi -pthread -fopenmp -Wno-deprecated -O2 -g -isystem /usr/include/eigen3 -I/usr/include/qt4 -I/usr/include/qt4/QtGui -I/usr/include/qt4/QtCore -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/obj-x86_64-linux-gnu/include -I/usr/include/vtk-5.8 -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/common/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/sample_consensus/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/io/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/kdtree/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/features/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/filters/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/geometry/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/keypoints/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/search/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/surface/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/registration/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/segmentation/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/octree/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/recognition/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/people/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/outofcore/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/visualization/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/test/gtest-1.6.0/include -I/tmp/buildd/ros-hydro-pcl-1.7.0-7quantal-20130710-2202/test/gtest-1.6.0 -DBOOST_DISABLE_ASSERTS -DEIGEN_NO_DEBUG -c -o /var/cache/pbuilder/ccache/a/0/1e79e835d464a8fc59eb53da2014c6-10599437.o.tmp.host05.storm.willowgarage.com.27403 /var/cache/pbuilder/ccache/tmp/test_regis.tmp.host05.storm.willowgarage.com.27403.ii
1234     28581  5.8 77.3 1915500 1353960 ?     D    Jul10   0:51                                                              \_ /usr/lib/gcc/x86_64-linux-gnu/4.7/cc1plus -fpreprocessed /var/cache/pbuilder/ccache/tmp/test_regis.tmp.host05.storm.willowgarage.com.27403.ii -quiet -dumpbase test_regis.tmp.host05.storm.willowgarage.com.27403.ii -mtune=generic -march=x86-64 -auxbase-strip /var/cache/pbuilder/ccache/a/0/1e79e835d464a8fc59eb53da2014c6-10599437.o.tmp.host05.storm.willowgarage.com.27403 -g -O2 -Wall -Wextra -Wno-unknown-pragmas -Wno-format-extra-args -Wno-sign-compare -Wno-invalid-offsetof -Wno-conversion -Wabi -Wno-deprecated -fno-strict-aliasing -fopenmp -fstack-protector -o /tmp/ccSTq990.s
tfoote commented 11 years ago

2 machines verified with this problem

tfoote commented 11 years ago

I found 5 or so of the 15. They all didn't seem to be runing the reaper for the current job and had all these old hung tests. They could be seen in the node list on jenkins as they had noteably slower ping times. Normal is < 100ms they were sometimes up to 500ms

tfoote commented 11 years ago

python: can't open file 'subprocess_reaper.py': [Errno 2] No such file or directory