search

ros-infrastructure / rosdoc_lite

A light-weight version of rosdoc that does not rely on ROS infrastructure for crawling packages.
10 stars 31 forks source link

Weird failure building fuerte doc job #43

Closed wjwwood closed 10 years ago

wjwwood commented 10 years ago

I get this:

See <http://jenkins.ros.org/job/doc-fuerte-serial/172/>

------------------------------------------
[...truncated 627 lines...]
-- Check for working C compiler: /usr/lib/ccache/gcc
-- Check for working C compiler: /usr/lib/ccache/gcc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working CXX compiler: /usr/lib/ccache/c++
-- Check for working CXX compiler: /usr/lib/ccache/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Found PythonInterp: /usr/bin/python (found version "2.7.3")
-- Looking for include files CMAKE_HAVE_PTHREAD_H
-- Looking for include files CMAKE_HAVE_PTHREAD_H - found
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
INFOBuilding GTest from source.
TODO: implement add_roslaunch_check() in rostest-extras.cmake.
-- Building stack rosdoc_lite
-- Configuring done
-- Generating done
-- Build files have been written to: <http://jenkins.ros.org/job/doc-fuerte-serial/ws/rosdoc_lite/build>
Executing command 'make'
Scanning dependencies of target gtest
[ 50%] Building CXX object gtest/CMakeFiles/gtest.dir/src/gtest-all.cc.o
Linking CXX shared library libgtest.so
[ 50%] Built target gtest
Scanning dependencies of target gtest_main
[100%] Building CXX object gtest/CMakeFiles/gtest_main.dir/src/gtest_main.cc.o
Linking CXX shared library libgtest_main.so
[100%] Built target gtest_main
Executing command 'make install'
[ 50%] Built target gtest
[100%] Built target gtest_main
Install the project...
-- Install configuration: ""
-- Installing: /usr/local/share/rosdoc_lite/stack.xml
-- Installing: /usr/local/lib/pkgconfig/rosdoc_lite.pc
-- Installing: /usr/local/share/rosdoc_lite/cmake/rosdoc_lite-config.cmake
-- Installing: /usr/local/share/rosdoc_lite/cmake/rosdoc_lite-config-version.cmake
+ [ -n  ]
+ cd <http://jenkins.ros.org/job/doc-fuerte-serial/ws/rosdoc_lite>
+ /usr/bin/env PYTHONPATH=/usr/local/lib/python2.7/dist-packages:<http://jenkins.ros.org/job/doc-fuerte-serial/ws/rosdoc_lite/build/gen/py>:/opt/ros/fuerte/lib/python2.7/dist-packages: CATKIN_BINARY_DIR=<http://jenkins.ros.org/job/doc-fuerte-serial/ws/rosdoc_lite/build> /usr/bin/python <http://jenkins.ros.org/job/doc-fuerte-serial/ws/rosdoc_lite/setup.py> install --install-layout=deb --prefix=/usr/local
/usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'install_requires'
  warnings.warn(msg)
running install
running build
running build_py
creating build/lib.linux-x86_64-2.7
creating build/lib.linux-x86_64-2.7/rosdoc_lite
copying src/rosdoc_lite/doxygenator.py -> build/lib.linux-x86_64-2.7/rosdoc_lite
copying src/rosdoc_lite/landing_page.py -> build/lib.linux-x86_64-2.7/rosdoc_lite
copying src/rosdoc_lite/sphinxenator.py -> build/lib.linux-x86_64-2.7/rosdoc_lite
copying src/rosdoc_lite/rdcore.py -> build/lib.linux-x86_64-2.7/rosdoc_lite
copying src/rosdoc_lite/__init__.py -> build/lib.linux-x86_64-2.7/rosdoc_lite
copying src/rosdoc_lite/python_paths.py -> build/lib.linux-x86_64-2.7/rosdoc_lite
copying src/rosdoc_lite/epyenator.py -> build/lib.linux-x86_64-2.7/rosdoc_lite
copying src/rosdoc_lite/msgenator.py -> build/lib.linux-x86_64-2.7/rosdoc_lite
creating build/lib.linux-x86_64-2.7/rosdoc_lite/templates
copying src/rosdoc_lite/templates/msg.template -> build/lib.linux-x86_64-2.7/rosdoc_lite/templates
copying src/rosdoc_lite/templates/doxy.template -> build/lib.linux-x86_64-2.7/rosdoc_lite/templates
copying src/rosdoc_lite/templates/msg-index.template -> build/lib.linux-x86_64-2.7/rosdoc_lite/templates
copying src/rosdoc_lite/templates/doxygen.css -> build/lib.linux-x86_64-2.7/rosdoc_lite/templates
copying src/rosdoc_lite/templates/footer.html -> build/lib.linux-x86_64-2.7/rosdoc_lite/templates
copying src/rosdoc_lite/templates/msg-styles.css -> build/lib.linux-x86_64-2.7/rosdoc_lite/templates
copying src/rosdoc_lite/templates/landing.template -> build/lib.linux-x86_64-2.7/rosdoc_lite/templates
copying src/rosdoc_lite/templates/manifest.html -> build/lib.linux-x86_64-2.7/rosdoc_lite/templates
copying src/rosdoc_lite/templates/header.html -> build/lib.linux-x86_64-2.7/rosdoc_lite/templates
copying src/rosdoc_lite/templates/styles.css -> build/lib.linux-x86_64-2.7/rosdoc_lite/templates
copying src/rosdoc_lite/templates/action.template -> build/lib.linux-x86_64-2.7/rosdoc_lite/templates
running build_scripts
creating build/scripts-2.7
copying and adjusting scripts/rosdoc_lite -> build/scripts-2.7
changing mode of build/scripts-2.7/rosdoc_lite from 644 to 755
running install_lib
creating /usr/local/lib/python2.7/dist-packages/rosdoc_lite
copying build/lib.linux-x86_64-2.7/rosdoc_lite/doxygenator.py -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite
copying build/lib.linux-x86_64-2.7/rosdoc_lite/landing_page.py -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite
copying build/lib.linux-x86_64-2.7/rosdoc_lite/sphinxenator.py -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite
copying build/lib.linux-x86_64-2.7/rosdoc_lite/rdcore.py -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite
creating /usr/local/lib/python2.7/dist-packages/rosdoc_lite/templates
copying build/lib.linux-x86_64-2.7/rosdoc_lite/templates/msg.template -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite/templates
copying build/lib.linux-x86_64-2.7/rosdoc_lite/templates/doxy.template -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite/templates
copying build/lib.linux-x86_64-2.7/rosdoc_lite/templates/msg-index.template -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite/templates
copying build/lib.linux-x86_64-2.7/rosdoc_lite/templates/doxygen.css -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite/templates
copying build/lib.linux-x86_64-2.7/rosdoc_lite/templates/footer.html -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite/templates
copying build/lib.linux-x86_64-2.7/rosdoc_lite/templates/msg-styles.css -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite/templates
copying build/lib.linux-x86_64-2.7/rosdoc_lite/templates/landing.template -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite/templates
copying build/lib.linux-x86_64-2.7/rosdoc_lite/templates/manifest.html -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite/templates
copying build/lib.linux-x86_64-2.7/rosdoc_lite/templates/header.html -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite/templates
copying build/lib.linux-x86_64-2.7/rosdoc_lite/templates/styles.css -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite/templates
copying build/lib.linux-x86_64-2.7/rosdoc_lite/templates/action.template -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite/templates
copying build/lib.linux-x86_64-2.7/rosdoc_lite/__init__.py -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite
copying build/lib.linux-x86_64-2.7/rosdoc_lite/python_paths.py -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite
copying build/lib.linux-x86_64-2.7/rosdoc_lite/epyenator.py -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite
copying build/lib.linux-x86_64-2.7/rosdoc_lite/msgenator.py -> /usr/local/lib/python2.7/dist-packages/rosdoc_lite
byte-compiling /usr/local/lib/python2.7/dist-packages/rosdoc_lite/doxygenator.py to doxygenator.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/rosdoc_lite/landing_page.py to landing_page.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/rosdoc_lite/sphinxenator.py to sphinxenator.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/rosdoc_lite/rdcore.py to rdcore.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/rosdoc_lite/__init__.py to __init__.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/rosdoc_lite/python_paths.py to python_paths.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/rosdoc_lite/epyenator.py to epyenator.pyc
byte-compiling /usr/local/lib/python2.7/dist-packages/rosdoc_lite/msgenator.py to msgenator.pyc
running install_scripts
copying build/scripts-2.7/rosdoc_lite -> /usr/local/bin
changing mode of /usr/local/bin/rosdoc_lite to 755
running install_egg_info
Writing /usr/local/lib/python2.7/dist-packages/rosdoc_lite-0.1.3.egg-info
Executing command 'apt-get install python-kitchen --yes'
Reading package lists...
Building dependency tree...
Reading state information...
The following extra packages will be installed:
  python-chardet
The following NEW packages will be installed:
  python-chardet python-kitchen
debconf: delaying package configuration, since apt-utils is not installed
0 upgraded, 2 newly installed, 0 to remove and 9 not upgraded.
Need to get 0 B/243 kB of archives.
After this operation, 986 kB of additional disk space will be used.
Selecting previously unselected package python-chardet.
(Reading database ... 35940 files and directories currently installed.)
Unpacking python-chardet (from .../python-chardet_2.0.1-2build1_all.deb) ...
Selecting previously unselected package python-kitchen.
Unpacking python-kitchen (from .../python-kitchen_1.0.0-0ubuntu2_all.deb) ...
Setting up python-chardet (2.0.1-2build1) ...
Setting up python-kitchen (1.0.0-0ubuntu2) ...
Executing command 'apt-get install python-catkin-pkg python-docutils python-rospkg python-networkx --yes'
Reading package lists...
Building dependency tree...
Reading state information...
python-docutils is already the newest version.
python-docutils set to manually installed.
python-networkx is already the newest version.
python-catkin-pkg is already the newest version.
python-catkin-pkg set to manually installed.
python-rospkg is already the newest version.
python-rospkg set to manually installed.
0 upgraded, 0 newly installed, 0 to remove and 9 not upgraded.
Executing command 'apt-get install graphviz python-sphinx python-yaml doxygen python-epydoc --yes'
Reading package lists...
Building dependency tree...
Reading state information...
python-sphinx is already the newest version.
doxygen is already the newest version.
graphviz is already the newest version.
python-epydoc is already the newest version.
python-yaml is already the newest version.
0 upgraded, 0 newly installed, 0 to remove and 9 not upgraded.
Installed catkin_basic
Done installing ros
Repo path <http://jenkins.ros.org/job/doc-fuerte-serial/ws/doc_stacks/2013-12-07_11-24-22.612532>
Looking for the packages in <http://jenkins.ros.org/job/doc-fuerte-serial/ws/doc_stacks/2013-12-07_11-24-22.612532/serial>
Running documentation generation on
packages: ['serial']
Ininitalize rosdep database
Executing command 'apt-get install --yes lsb-release python-rosdep'
Reading package lists...
Building dependency tree...
Reading state information...
lsb-release is already the newest version.
The following NEW packages will be installed:
  python-rosdep
debconf: delaying package configuration, since apt-utils is not installed
0 upgraded, 1 newly installed, 0 to remove and 9 not upgraded.
Need to get 0 B/47.1 kB of archives.
After this operation, 264 kB of additional disk space will be used.
Selecting previously unselected package python-rosdep.
(Reading database ... 36128 files and directories currently installed.)
Unpacking python-rosdep (from .../python-rosdep_0.10.24-1_all.deb) ...
Setting up python-rosdep (0.10.24-1) ...
Processing triggers for python-support ...
Executing command 'rosdep init'
Wrote /etc/ros/rosdep/sources.list.d/20-default.list
Recommended: please run

        rosdep update

Executing command 'rosdep update'
Warning: running 'rosdep update' as root is not recommended.
  You should remove the rosdep database with 'sudo rm -fr /home/rosbuild/.ros/rosdep/sources.cache' and invoke 'rosdep update' again without sudo.
reading in sources list data from /etc/ros/rosdep/sources.list.d
Hit https://github.com/ros/rosdistro/raw/master/rosdep/osx-homebrew.yaml
Hit https://github.com/ros/rosdistro/raw/master/rosdep/gentoo.yaml
Hit https://github.com/ros/rosdistro/raw/master/rosdep/base.yaml
Hit https://github.com/ros/rosdistro/raw/master/rosdep/python.yaml
Hit https://github.com/ros/rosdistro/raw/master/rosdep/ruby.yaml
Hit https://github.com/ros/rosdistro/raw/master/releases/fuerte.yaml
Ignore legacy gbpdistro "groovy"
Ignore legacy gbpdistro "hydro"
Query rosdistro index https://raw.github.com/ros/rosdistro/master/index.yaml
Add distro "groovy"
Add distro "hydro"
updated cache in /home/rosbuild/.ros/rosdep/sources.cache
Building dictionaries from a rosdep's db
Executing command 'rosdep db'
Dependencies: ['catkin', 'boost']
Apt dependencies: [u'ros-fuerte-catkin', u'libboost-all-dev']
Build order that honors deps:
['serial']
Getting dependencies for ros-fuerte-catkin
Getting dependencies for libboost-all-dev
Installing all dependencies for serial
Executing command 'apt-get install ros-fuerte-catkin libboost-all-dev --yes'
Reading package lists...
Building dependency tree...
Reading state information...
libboost-all-dev is already the newest version.
libboost-all-dev set to manually installed.
ros-fuerte-catkin is already the newest version.
ros-fuerte-catkin set to manually installed.
0 upgraded, 0 newly installed, 0 to remove and 9 not upgraded.
Done installing dependencies
Removing the CMakeLists.txt file generated by rosinstall
Retrieve the ROS build environment by sourcing /opt/ros/fuerte/setup.bash
Calling cmake...
Executing command 'catkin_init_workspace <http://jenkins.ros.org/job/doc-fuerte-serial/ws/doc_stacks/2013-12-07_11-24-22.612532'>
Traceback (most recent call last):
  File "<http://jenkins.ros.org/job/doc-fuerte-serial/ws/jenkins_scripts/doc",> line 209, in <module>
    main()
  File "<http://jenkins.ros.org/job/doc-fuerte-serial/ws/jenkins_scripts/doc",> line 119, in main
    doit(args.rosdistro, args.repo, workspace, docspace, args.platform, args.arch, args.no_chroot, args.skip_garbage, args.force)
  File "<http://jenkins.ros.org/job/doc-fuerte-serial/ws/jenkins_scripts/doc",> line 205, in doit
    homepage, no_chroot, skip_garbage, **necessary)
  File "<http://jenkins.ros.org/job/doc-fuerte-serial/ws/jenkins_scripts/doc_stack.py",> line 404, in document_repo
    source, errs = build_repo_messages(catkin_packages, docspace, ros_distro, local_install_path)
  File "<http://jenkins.ros.org/job/doc-fuerte-serial/ws/jenkins_scripts/message_generation.py",> line 298, in build_repo_messages
    call("catkin_init_workspace %s" % docspace, ros_env)
  File "<http://jenkins.ros.org/job/doc-fuerte-serial/ws/jenkins_scripts/common.py",> line 137, in call
    return call_with_list(command.split(' '), envir, verbose)
  File "<http://jenkins.ros.org/job/doc-fuerte-serial/ws/jenkins_scripts/common.py",> line 115, in call_with_list
    helper = subprocess.Popen(command, stdout=subprocess.PIPE, stderr=subprocess.STDOUT, close_fds=True, env=envir)
  File "/usr/lib/python2.7/subprocess.py", line 679, in __init__
    errread, errwrite)
  File "/usr/lib/python2.7/subprocess.py", line 1249, in _execute_child
    raise child_exception
OSError: [Errno 2] No such file or directory
I: Copying back the cached apt archive contents
I: unmounting /var/cache/pbuilder/ccache filesystem
I: unmounting <http://jenkins.ros.org/job/doc-fuerte-serial/ws/> filesystem
I: unmounting /home/rosbuild filesystem
I: unmounting dev/pts filesystem
I: unmounting proc filesystem
I: cleaning the build env
I: removing directory /var/cache/pbuilder/build//18397 and its subdirectories
Build step 'Execute shell' marked build as failure
Build step 'Groovy Postbuild' marked build as failure
Recording test results

I don't understand from looking at the error what the problem is.

jack-oquin commented 10 years ago

Looks to me like it's crashing in jenkins_scripts common.py trying to execute some command, maybe catkin_init_workspace.

Does that even work on Fuerte?

wjwwood commented 10 years ago

Yes, I think the problem is that catkin_init_workspace is not part of catkin in fuerte. The reason I opened the ticket is that I don't know why fuerte jobs are trying to use catkin_init_workspace, probably a regression in rosdoc_lite.

jack-oquin commented 10 years ago

There is a separate fuerte-devel branch of rosdoc_lite.

I don't either branch of rosdoc_lite uses catkin_init_workspace. It must be jenkins_scripts doing that.

wjwwood commented 10 years ago

Yes, I agree that it is likely a problem in some part of the build farm code, but as I don't know where it originates from, I opened the issue here. @dirk-thomas do you have any idea here, or maybe which tracker I should move the issue to?

dirk-thomas commented 10 years ago

As the log states catkin has been installed (ros-fuerte-catkin is already the newest version). And in Fuerte catkin also has a catkin_init_workspace script (https://github.com/ros/catkin/blob/fuerte-devel/bin/catkin_init_workspace). Also the environment was sourced before (Retrieve the ROS build environment by sourcing /opt/ros/fuerte/setup.bash).

I can't see the reason why it fails. But since the Fuerte jobs will be removed as soon as we start building Indigo (within a couple of weeks) I will likely not spend any time to investigate this.

dirk-thomas commented 10 years ago

The Fuerte build farm has been decommissioned by now.