stan-dev / stan

Stan development repository. The master branch contains the current release. The develop branch contains the latest stable development. See the Developer Process Wiki for details.
https://mc-stan.org
BSD 3-Clause "New" or "Revised" License
2.6k stars 370 forks source link

Disable precompiled headers for integration tests #3093

Closed rok-cesnovar closed 2 years ago

rok-cesnovar commented 2 years ago

Summary

Integration tests still occasionally fail with the .pch error. Still haven't gotten to the bottom of why. It seems that somewhere in CI we are not cleaning up after the last run. This is a CI-only issue so I am going to try running without integration tests to see what the test runtime hit is. If its not bad, lets just do that to avoid this annoyance.

Copyright and Licensing

Please list the copyright holder for the work you are submitting (this will be you or your assignee, such as a university or company): Rok Češnovar

By submitting this pull request, the copyright holder is agreeing to license the submitted work under the following licenses:

stan-buildbot commented 2 years ago

Name Old Result New Result Ratio Performance change( 1 - new / old )
gp_pois_regr/gp_pois_regr.stan 3.83 3.56 1.08 7.03% faster
low_dim_corr_gauss/low_dim_corr_gauss.stan 0.02 0.02 0.96 -4.23% slower
eight_schools/eight_schools.stan 0.09 0.09 1.02 2.11% faster
gp_regr/gp_regr.stan 0.15 0.14 1.02 2.34% faster
irt_2pl/irt_2pl.stan 5.72 5.7 1.0 0.27% faster
performance.compilation 93.46 90.95 1.03 2.68% faster
low_dim_gauss_mix_collapse/low_dim_gauss_mix_collapse.stan 8.11 8.12 1.0 -0.03% slower
pkpd/one_comp_mm_elim_abs.stan 30.98 32.44 0.95 -4.72% slower
sir/sir.stan 119.34 119.33 1.0 0.01% faster
gp_regr/gen_gp_data.stan 0.03 0.03 1.01 1.16% faster
low_dim_gauss_mix/low_dim_gauss_mix.stan 3.01 2.97 1.01 1.06% faster
pkpd/sim_one_comp_mm_elim_abs.stan 0.42 0.38 1.08 7.67% faster
arK/arK.stan 2.08 2.09 1.0 -0.38% slower
arma/arma.stan 0.23 0.23 0.99 -0.78% slower
garch/garch.stan 0.58 0.57 1.01 0.53% faster

Mean result: 1.01099552949


Jenkins Console Log Blue Ocean Commit hash: 29715242b39bc563015563322158da6be5ba27e6


Machine information ProductName: Mac OS X ProductVersion: 10.11.6 BuildVersion: 15G22010 CPU: Intel(R) Xeon(R) CPU E5-1680 v2 @ 3.00GHz G++: Configured with: --prefix=/Applications/Xcode.app/Contents/Developer/usr --with-gxx-include-dir=/usr/include/c++/4.2.1 Apple LLVM version 7.0.2 (clang-700.1.81) Target: x86_64-apple-darwin15.6.0 Thread model: posix Clang: Apple LLVM version 7.0.2 (clang-700.1.81) Target: x86_64-apple-darwin15.6.0 Thread model: posix