search

catchorg / Catch2

A modern, C++-native, test framework for unit-tests, TDD and BDD - using C++14, C++17 and later (C++11 support is in v2.x branch, and C++03 on the Catch1.x branch)
https://discord.gg/4CWS9zD
Boost Software License 1.0
18.46k stars 3.02k forks source link

compact.sw approval test fails in 2.2.1 #1222

Closed greenc-FNAL closed 5 years ago

greenc-FNAL commented 6 years ago

Description

As a supplemental to issue #1200, we are trying to build and test Catch 2.2.1, and in addition to the path-related issues with the XML tests, we are getting complaints with the compact.sw test. In contrast to issue #1200 we appear to get the same problems with an in-source build.

Steps to reproduce

CXX=g++ CC=gcc cmake -DCMAKE_INSTALL_PREFIX= -DUSE_CPP14:BOOL=ON . make -j<#> ctest -j<#> --output-on-failure

Extra information

fail.log

horenmar commented 6 years ago

After some investigation, both of these have the same underlying reason: the machinery for normalizing the output to be comparable between different computers is a bit creaky and fails to work on your PC properly.

ATM there are ~3 issues where the machinery fails, so I will have to work on that soon.