integration tests are working fine in the CI on github
some fail when running locally, e.g. pytest --no-cov "tests/integration_tests/test_applications_from_config.py::test_applications_from_config[simtools-calculate-trigger-rate_file_list]"
they don't fail when adding the model version, e.g., pytest --model_version="2024-02-01" --no-cov "tests/integration_tests/test_applications_from_config.py::test_applications_from_config[simtools-calculate-trigger-rate_file_list]"
Failing are tests which do not have OUTPUT_PATH configured, but are using the functionality to locate or compare output files. I tried to understand what happens in test_applications_from_config.py, but it is not absolutely clear to me. The easiest fix is to configure explicitly OUTPUT_PATH in the test configuration to make sure that tests are written into the temp_test_directory (otherwise tests are writing locally).
Interesting issue:
pytest --no-cov "tests/integration_tests/test_applications_from_config.py::test_applications_from_config[simtools-calculate-trigger-rate_file_list]"
pytest --model_version="2024-02-01" --no-cov "tests/integration_tests/test_applications_from_config.py::test_applications_from_config[simtools-calculate-trigger-rate_file_list]"
Failing are tests which do not have
OUTPUT_PATH
configured, but are using the functionality to locate or compare output files. I tried to understand what happens intest_applications_from_config.py
, but it is not absolutely clear to me. The easiest fix is to configure explicitlyOUTPUT_PATH
in the test configuration to make sure that tests are written into the temp_test_directory (otherwise tests are writing locally).