search

gazebosim / gz-sim

Open source robotics simulator. The latest version of Gazebo.
https://gazebosim.org
Apache License 2.0
657 stars 258 forks source link

:farmer: `CmdLine` tests failing in gz-sim7, ign-gazebo6 and ign-gazebo3 Homebrew #1867

Closed Crola1702 closed 1 year ago

Crola1702 commented 1 year ago

Environment

Description

Steps to reproduce

  1. Run a build in gz-sim7-homebrew, ign-gazebo6-homebrew or ign-gazebo3-homebrew
  2. See 5 test regressions

Output

Reference builds:

Failing tests:

Gz-sim7 log output:

The following tests FAILED:
     53 - UNIT_gz_TEST (Failed)
    263 - testFixture_TEST (Failed)

Test 53 - UNIT_gz_TEST:

``` test 53 Start 53: UNIT_gz_TEST 53: Test command: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/bin/UNIT_gz_TEST "--gtest_output=xml:/Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/test_results/UNIT_gz_TEST.xml" 53: Working Directory: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/src 53: Environment variables: 53: GZ_CONFIG_PATH=/Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/test/conf 53: GZ_SIM_SYSTEM_PLUGIN_PATH=/Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib 53: Test timeout computed to be: 240 53: Running main() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/test/gtest_vendor/src/gtest_main.cc 53: [==========] Running 7 tests from 1 test suite. 53: [----------] Global test environment set-up. 53: [----------] 7 tests from CmdLine 53: [ RUN ] CmdLine.Server 53: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/gz sim -s -r -v 4 --iterations 5 /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/test/worlds/plugins.sdf] 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:77: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:77: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:77: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:77: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:77: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: Running command [GZ_SIM_RESOURCE_PATH=/Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/test/worlds /usr/local/opt/ruby/bin/ruby /usr/local/bin/gz sim -s -r -v 4 --iterations 5 plugins.sdf] 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:95: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:95: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:95: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:95: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:95: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: [ FAILED ] CmdLine.Server (1522 ms) 53: [ RUN ] CmdLine.CachedFuelWorld 53: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/gz sim -s -r -v 4 --iterations 5 https://fuel.gazebosim.org/1.0/openroboticstest/worlds/test%20world] 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:111: Failure 53: Expected: (output.find("Cached world found.")) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: [ FAILED ] CmdLine.CachedFuelWorld (294 ms) 53: [ RUN ] CmdLine.GazeboServer 53: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/gz sim -s -r -v 4 --iterations 5 /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/test/worlds/plugins.sdf] 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:127: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:127: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:127: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:127: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:127: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: [ FAILED ] CmdLine.GazeboServer (295 ms) 53: [ RUN ] CmdLine.Gazebo 53: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/gz sim -s -r -v 4 --iterations 5 /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/test/worlds/plugins.sdf] 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:144: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:144: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:144: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:144: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:144: Failure 53: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: [ FAILED ] CmdLine.Gazebo (295 ms) 53: [ RUN ] CmdLine.ResourcePath 53: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/src/gz_TEST.cc:156: Failure 53: Expected: (output.find("Unable to find or download file")) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 53: Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib. 53: 53: [ FAILED ] CmdLine.ResourcePath (888 ms) 53: [ RUN ] CmdLine.GazeboHelpVsCompletionFlags 53: [ OK ] CmdLine.GazeboHelpVsCompletionFlags (155 ms) 53: [ RUN ] CmdLine.ModelHelpVsCompletionFlags 53: [ OK ] CmdLine.ModelHelpVsCompletionFlags (147 ms) 53: [----------] 7 tests from CmdLine (3599 ms total) 53: 53: [----------] Global test environment tear-down 53: [==========] 7 tests from 1 test suite ran. (3599 ms total) 53: [ PASSED ] 2 tests. 53: [ FAILED ] 5 tests, listed below: 53: [ FAILED ] CmdLine.Server 53: [ FAILED ] CmdLine.CachedFuelWorld 53: [ FAILED ] CmdLine.GazeboServer 53: [ FAILED ] CmdLine.Gazebo 53: [ FAILED ] CmdLine.ResourcePath 53: 53: 5 FAILED TESTS 53/263 Test #53: UNIT_gz_TEST ............................................***Failed 3.73 sec ```

Test 263 - testFixture_TEST:

``` test 263 Start 263: testFixture_TEST 263: Test command: /usr/local/Frameworks/Python.framework/Versions/3.11/bin/python3.11 "/Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/python/test/testFixture_TEST.py" 263: Working Directory: /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/python 263: Environment variables: 263: PYTHONPATH=/usr/local/Cellar/gz-sim7/HEAD/lib/python/ 263: LD_LIBRARY_PATH=/usr/local/Cellar/gz-sim7/HEAD/lib: 263: Test timeout computed to be: 1500 263: Traceback (most recent call last): 263: File "/Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/ign-gazebo/python/test/testFixture_TEST.py", line 21, in 263: from gz.math7 import Vector3d 263: ModuleNotFoundError: No module named 'gz.math7' 263/263 Test #263: testFixture_TEST ........................................***Failed 0.43 sec ```

Ign-gazebo3 output:

The following tests FAILED:
     13 - UNIT_ign_TEST (Failed)

Test 13 - UNIT_ign_TEST

``` test 13 Start 13: UNIT_ign_TEST 13: Test command: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/bin/UNIT_ign_TEST "--gtest_output=xml:/Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/test_results/UNIT_ign_TEST.xml" 13: Working Directory: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/src 13: Environment variables: 13: IGN_CONFIG_PATH=/Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/test/conf 13: IGN_GAZEBO_SYSTEM_PLUGIN_PATH=/Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib 13: Test timeout computed to be: 240 13: Running main() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/test/gtest/src/gtest_main.cc 13: [==========] Running 7 tests from 1 test suite. 13: [----------] Global test environment set-up. 13: [----------] 7 tests from CmdLine 13: [ RUN ] CmdLine.Server 13: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/ign gazebo -s -r -v 4 --iterations 5 /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/test/worlds/plugins.sdf] 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:77: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:77: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:77: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:77: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:77: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: Running command [IGN_GAZEBO_RESOURCE_PATH=/Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/test/worlds /usr/local/opt/ruby/bin/ruby /usr/local/bin/ign gazebo -s -r -v 4 --iterations 5 plugins.sdf] 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:92: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:92: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:92: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:92: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:92: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: [ FAILED ] CmdLine.Server (1413 ms) 13: [ RUN ] CmdLine.CachedFuelWorld 13: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/ign gazebo -s -r -v 4 --iterations 5 https://fuel.gazebosim.org/1.0/OpenRobotics/worlds/Test%20world] 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:107: Failure 13: Expected: (output.find("Cached world found.")) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: [ FAILED ] CmdLine.CachedFuelWorld (375 ms) 13: [ RUN ] CmdLine.GazeboServer 13: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/ign gazebo -s -r -v 4 --iterations 5 /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/test/worlds/plugins.sdf] 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:123: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:123: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:123: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:123: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:123: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: [ FAILED ] CmdLine.GazeboServer (377 ms) 13: [ RUN ] CmdLine.Gazebo 13: Running command [/usr/local/opt/ruby/bin/ruby /usr/local/bin/ign gazebo -s -r -v 4 --iterations 5 /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/test/worlds/plugins.sdf] 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:140: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:140: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:140: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:140: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:140: Failure 13: Expected: (output.find("iteration " + std::to_string(i))) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: [ FAILED ] CmdLine.Gazebo (373 ms) 13: [ RUN ] CmdLine.ResourcePath 13: /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/ign-gazebo/src/ign_TEST.cc:152: Failure 13: Expected: (output.find("Unable to find or download file")) != (std::string::npos), actual: 18446744073709551615 vs 18446744073709551615 13: Library error: Problem running [gazebo]() from /Users/jenkins/workspace/ignition_gazebo-ci-ign-gazebo3-homebrew-amd64/build/lib/libignition-gazebo3-ign.3.14.0.dylib. 13: 13: [ FAILED ] CmdLine.ResourcePath (1120 ms) 13: [ RUN ] CmdLine.GazeboHelpVsCompletionFlags 13: [ OK ] CmdLine.GazeboHelpVsCompletionFlags (151 ms) 13: [ RUN ] CmdLine.ModelHelpVsCompletionFlags 13: [ OK ] CmdLine.ModelHelpVsCompletionFlags (144 ms) 13: [----------] 7 tests from CmdLine (3953 ms total) 13: 13: [----------] Global test environment tear-down 13: [==========] 7 tests from 1 test suite ran. (3953 ms total) 13: [ PASSED ] 2 tests. 13: [ FAILED ] 5 tests, listed below: 13: [ FAILED ] CmdLine.Server 13: [ FAILED ] CmdLine.CachedFuelWorld 13: [ FAILED ] CmdLine.GazeboServer 13: [ FAILED ] CmdLine.Gazebo 13: [ FAILED ] CmdLine.ResourcePath 13: 13: 5 FAILED TESTS 13/174 Test #13: UNIT_ign_TEST ........................................***Failed 4.10 sec ```

Ign-launch2 has a similar issue, and is reported here: https://github.com/gazebosim/gz-launch/issues/208

scpeters commented 1 year ago

I wonder if it's a DYLD_LIBRARY_PATH issue? I'll see if I can reproduce on my machine

Library error: Problem running [sim]() from /Users/jenkins/workspace/ignition_gazebo-ci-gz-sim7-homebrew-amd64/build/lib/libgz-sim7-gz.7.1.0.dylib
scpeters commented 1 year ago

I have a fix for some of the tests in https://github.com/gazebosim/gz-sim/pull/1884 targeting gz-sim7. We can backport to ign-gazebo3 if it works

Crola1702 commented 1 year ago

We can backport to ign-gazebo3 if it works

Actually, it works fine. We don't have any new test regressions. I see backport to gazebo3. Do we have one for gazebo6?

scpeters commented 1 year ago

We can backport to ign-gazebo3 if it works

Actually, it works fine. We don't have any new test regressions. I see backport to gazebo3. Do we have one for gazebo6?

we'll forward port from ign-gazebo3 to ign-gazebo6 after https://github.com/gazebosim/gz-sim/pull/1885 is merged

Crola1702 commented 1 year ago

Closing as this problem was solved with the PRs mentioned on previous comments