circle ci vcg download error (sporadic)

[markus-stoll]

$chmod 755 share/install_msml.sh && share/install_msml.sh

+ mkdir cbuild
+ cd cbuild
+ ROOT=/home/ubuntu/msml/
+ cmake -DVTK_DIR=/home/ubuntu/msml//cache/VTK-6.1.0-BUILD/ -DTETGEN_INCLUDE_DIRS=/home/ubuntu/msml//cache/tetgen1.5.0 -DTETGEN_LIBRARY=/home/ubuntu/msml//cache/tetgen-build/libtet.a -DSOFA_EXECUTABLE=/home/ubuntu/msml/cache/sofa-build/bin/runSofa /home/ubuntu/msml//operators
-- The C compiler identification is GNU 4.6.3
-- The CXX compiler identification is GNU 4.6.3
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
 #############################
 # CMAKE BUILD TYPE = Release
 #############################
-- Found SWIG: /usr/bin/swig2.0 (found version "2.0.11") 
-- Boost version: 1.54.0
-- Found the following Boost libraries:
--   program_options
--   unit_test_framework
--   filesystem
--   iostreams
--   regex
--   system
--   iostreams
-- Found PythonLibs: /usr/lib/x86_64-linux-gnu/libpython2.7.so
Base: ENABLED and ACTIVE
TetgenOperators: ENABLED and ACTIVE
MiscMeshOperators needed by VCGOperators
-- Found Subversion: /usr/bin/svn (found version "1.6.17") 
VCGOperators: ENABLED and ACTIVE
VCG install dir is /home/ubuntu/msml/cbuild/VCGOperators/vcg
MiscMeshOperators: ENABLED and ACTIVE
-- Boost version: 1.54.0
CGALOperators: ENABLED and ACTIVE
-- Build type: Release
-- USING CXXFLAGS = '-g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security -D_FORTIFY_SOURCE=2  -frounding-math -O3 -DNDEBUG'
-- USING EXEFLAGS = ' -Wl,-Bsymbolic-functions -Wl,-z,relro -Wl,--as-needed '
-- Targetting Unix Makefiles
-- Using /usr/bin/c++ compiler.
-- Requested component: Core
-- Requested component: ImageIO
-- Looking for XOpenDisplay in /usr/lib/x86_64-linux-gnu/libX11.so;/usr/lib/x86_64-linux-gnu/libXext.so
-- Looking for XOpenDisplay in /usr/lib/x86_64-linux-gnu/libX11.so;/usr/lib/x86_64-linux-gnu/libXext.so - found
-- Looking for gethostbyname
-- Looking for gethostbyname - found
-- Looking for connect
-- Looking for connect - found
-- Looking for remove
-- Looking for remove - found
-- Looking for shmat
-- Looking for shmat - found
-- Looking for IceConnectionNumber in ICE
-- Looking for IceConnectionNumber in ICE - found
-- Found X11: /usr/lib/x86_64-linux-gnu/libX11.so
-- Found OpenGL: /usr/lib/x86_64-linux-gnu/libGL.so  
-- Found ZLIB: /usr/lib/x86_64-linux-gnu/libz.so (found version "1.2.3.4") 
-- Requested component: MPFR
-- Requested component: GMP
ACVD as external project
-- Found Git: /usr/bin/git (found version "1.8.5.5") 
ACVDOperators: ENABLED and ACTIVE
ACVD include are /home/ubuntu/msml/cbuild/ACVDOperators/acvd/src/ACVD/vtkDiscreteRemeshing/;/home/ubuntu/msml/cbuild/ACVDOperators/acvd/src/ACVD/vtkSurface/;/home/ubuntu/msml/cbuild/ACVDOperators/acvd/src/ACVD/vtkVolumeProcessing/;/home/ubuntu/msml/cbuild/ACVDOperators/acvd/src/ACVD/DiscreteRemeshing/;/home/ubuntu/msml/cbuild/ACVDOperators/acvd/src/ACVD/Common/;/home/ubuntu/msml/cbuild/ACVDOperators/acvd/src/ACVD/VolumeProcessing/
-- Configuring done
-- Generating done
-- Build files have been written to: /home/ubuntu/msml/cbuild
+ make -j 3
Scanning dependencies of target Base
Scanning dependencies of target VCG
Scanning dependencies of target TetgenOperators
[  1%] Creating directories for 'VCG'
[  3%] [  4%] Building CXX object Base/CMakeFiles/Base.dir/__/common/log.cpp.o
[  6%] Performing download step (SVN checkout) for 'VCG'
Building CXX object TetgenOperators/CMakeFiles/TetgenOperators.dir/TetgenOperators.cpp.o
Linking CXX shared library ../bin/libBase.so
[  6%] Built target Base
Scanning dependencies of target MiscMeshOperators
CMake Error at VCG-stamp/VCG-download.cmake:16 (message):
  Command failed: 1

   '/usr/bin/svn' 'co' 'http://svn.code.sf.net/p/vcg/code/trunk' '--non-interactive' 'VCG'

  See also

    /home/ubuntu/msml/cbuild/VCGOperators/vcg/src/VCG-stamp/VCG-download-*.log

make[2]: *** [VCGOperators/vcg/src/VCG-stamp/VCG-download] Error 1
make[1]: *** [VCGOperators/CMakeFiles/VCG.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
[  7%] Building CXX object TetgenOperators/CMakeFiles/TetgenOperators.dir/__/common/log.cpp.o
[  9%] [ 10%] Building CXX object MiscMeshOperators/CMakeFiles/MiscMeshOperators.dir/IOHelper.cpp.o
Building CXX object MiscMeshOperators/CMakeFiles/MiscMeshOperators.dir/MiscMeshOperators.cpp.o
Linking CXX shared library ../bin/libTetgenOperators.so
[ 10%] Built target TetgenOperators
[ 12%] Building CXX object MiscMeshOperators/CMakeFiles/MiscMeshOperators.dir/PostProcessingOperators.cpp.o
/home/ubuntu/msml/operators/MiscMeshOperators/IOHelper.cpp: In function ‘vtkSmartPointer<vtkImageData> MSML::IOHelper::VTKReadImage(const char*)’:
/home/ubuntu/msml/operators/MiscMeshOperators/IOHelper.cpp:184:28: warning: ignoring return value of ‘int system(const char*)’, declared with attribute warn_unused_result [-Wunused-result]
[ 13%] Building CXX object MiscMeshOperators/CMakeFiles/MiscMeshOperators.dir/IndexRegionOperators.cpp.o
[ 15%] Building CXX object MiscMeshOperators/CMakeFiles/MiscMeshOperators.dir/MappingOperators.cpp.o
[ 16%] Building CXX object MiscMeshOperators/CMakeFiles/MiscMeshOperators.dir/VTKMeshgen.cpp.o
[ 18%] Building CXX object MiscMeshOperators/CMakeFiles/MiscMeshOperators.dir/MeshQualityOperators.cpp.o
[ 20%] Building CXX object MiscMeshOperators/CMakeFiles/MiscMeshOperators.dir/MeshInfoOperators.cpp.o
[ 21%] Building CXX object MiscMeshOperators/CMakeFiles/MiscMeshOperators.dir/FeatureExtractionOperators.cpp.o
[ 23%] Building CXX object MiscMeshOperators/CMakeFiles/MiscMeshOperators.dir/FeBioSupport.cpp.o
[ 24%] Building CXX object MiscMeshOperators/CMakeFiles/MiscMeshOperators.dir/SurfaceToVoxelDataOperator.cpp.o
[ 26%] Building CXX object MiscMeshOperators/CMakeFiles/MiscMeshOperators.dir/Sources.cpp.o
[ 27%] Building CXX object MiscMeshOperators/CMakeFiles/MiscMeshOperators.dir/__/common/log.cpp.o
Linking CXX shared library ../bin/libMiscMeshOperators.so
[ 27%] Built target MiscMeshOperators
make: *** [all] Error 2
+ exit chmod 755 share/install_msml.sh && share/install_msml.sh returned exit code 2action chmod 755 share/install_msml.sh && share/install_msml.sh failed

[markus-stoll]

a retry for the whole build helps sometimes.

[dschauba]

Happened again, just now. Manual retry fixed the problem, again: https://circleci.com/gh/CognitionGuidedSurgery/msml/337

[wadoon]

Debugging this is hard. We could add the log files to the artifacts.

[markus-stoll]

it seems to be better now - did we change anything?

[wadoon]

No

[wadoon]

My new experience with ExternalProject_Add is that using tarballs or zip files speeds up build process and does not require the existence of Internet connection after a download once. Especially if we set a external download folder. Otherwise wie could add a source folder external third parties projects and still use ExternalProject_Add.