Genentech / jmpost

https://genentech.github.io/jmpost/
17 stars 4 forks source link

Remove model cache #343

Closed gowerc closed 5 months ago

gowerc commented 5 months ago

Currently every other model run on GitHub actions is failing due to what I think is an issue with the GitHub cache. Theres no obvious reason as to why this is happening so will need to investigate at a later date. For now I'm just going to disable the GitHub cache so that the models are recompiled from scratch each time.

github-actions[bot] commented 5 months ago

badge

Code Coverage Summary

Filename                           Stmts    Miss  Cover    Missing
-------------------------------  -------  ------  -------  --------------------------------
R/brier_score.R                      166       0  100.00%
R/DataJoint.R                         76       2  97.37%   264, 270
R/DataLongitudinal.R                 119       1  99.16%   244
R/DataSubject.R                       85       1  98.82%   142
R/DataSurvival.R                      98       0  100.00%
R/defaults.R                          10       6  40.00%   18-57, 84
R/generics.R                          31       4  87.10%   51, 395, 414, 449
R/Grid.R                              27       1  96.30%   170
R/GridEven.R                          32       0  100.00%
R/GridFixed.R                         30       0  100.00%
R/GridGrouped.R                       52       0  100.00%
R/GridManual.R                        23       3  86.96%   78-80
R/GridObserved.R                      20       0  100.00%
R/GridPopulation.R                    31       4  87.10%   61, 69-71
R/GridPrediction.R                    36       6  83.33%   83, 91-95
R/JointModel.R                       123       8  93.50%   141-143, 193, 197, 239, 285, 291
R/JointModelSamples.R                 59       0  100.00%
R/link_generics.R                     13       3  76.92%   59, 76, 91
R/Link.R                              62       4  93.55%   200-203
R/LinkComponent.R                     19       3  84.21%   88, 120-121
R/LongitudinalGSF.R                   82       0  100.00%
R/LongitudinalModel.R                 19       0  100.00%
R/LongitudinalQuantities.R            71       0  100.00%
R/LongitudinalRandomSlope.R           41       5  87.80%   93-97
R/LongitudinalSteinFojo.R             75       5  93.33%   143-147
R/Parameter.R                         14       0  100.00%
R/ParameterList.R                     42       1  97.62%   184
R/Prior.R                            236       8  96.61%   481, 577, 589-607
R/Promise.R                           25       0  100.00%
R/Quantities.R                        60       0  100.00%
R/QuantityGeneratorPopulation.R       22       0  100.00%
R/QuantityGeneratorPrediction.R       48       0  100.00%
R/QuantityGeneratorSubject.R          19       0  100.00%
R/settings.R                          12      12  0.00%    55-69
R/SimGroup.R                           5       0  100.00%
R/SimJointData.R                      72       1  98.61%   103
R/SimLongitudinal.R                    5       2  60.00%   22, 40
R/SimLongitudinalGSF.R                53       0  100.00%
R/SimLongitudinalRandomSlope.R        42       0  100.00%
R/SimLongitudinalSteinFojo.R          50       0  100.00%
R/SimSurvival.R                      104       0  100.00%
R/StanModel.R                         15       0  100.00%
R/StanModule.R                       176       6  96.59%   192-193, 235, 246, 383, 411
R/SurvivalExponential.R               10       0  100.00%
R/SurvivalLoglogistic.R               11       0  100.00%
R/SurvivalModel.R                     19       0  100.00%
R/SurvivalQuantities.R               170       1  99.41%   125
R/SurvivalWeibullPH.R                 11       0  100.00%
R/utilities.R                        143       1  99.30%   13
R/zzz.R                               28      25  10.71%   3, 8-12, 14-35, 47
TOTAL                               2792     113  95.95%

Diff against main

Filename      Stmts    Miss  Cover
----------  -------  ------  --------
TOTAL             0       0  +100.00%

Results for commit: 68bb8df430ebe3652f6f92a16c0a0c8dd2dafca7

Minimum allowed coverage is 80%

:recycle: This comment has been updated with latest results

github-actions[bot] commented 5 months ago

Unit Tests Summary

  1 files  140 suites   7m 54s :stopwatch: 131 tests 104 :white_check_mark: 27 :zzz: 0 :x: 929 runs  897 :white_check_mark: 32 :zzz: 0 :x:

Results for commit 68bb8df4.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 5 months ago

Unit Test Performance Difference

Test Suite $Status$ Time on main $±Time$ $±Tests$ $±Skipped$ $±Failures$ $±Errors$
Grid 👶 $+0.00$ $+1$ $0$ $0$ $0$
JointModelSamples 💔 $1.26$ $+35.71$ $0$ $0$ $0$ $0$
compile 💔 $5.41$ $+9.72$ $0$ $0$ $0$ $0$
extract_quantities 💔 $0.38$ $+7.03$ $0$ $0$ $0$ $0$
model_multi_chain 💔 $3.84$ $+37.20$ $0$ $0$ $0$ $0$
Additional test case details | Test Suite | $Status$ | Time on `main` | $±Time$ | Test Case | |:-----|:----:|:----:|:----:|:-----| | DataSurvival | 💀 | $20.56$ | $-20.56$ | _unnamed_ | | Grid | 👶 | | $+0.00$ | GridFixed_bug_has_been_fixed | | Grid | 👶 | | $+0.01$ | GridObservered_Constructs_correct_quantities | | Grid | 👶 | | $+0.00$ | GridPopulation_doesn_t_work_with_SurvivalQuantities | | Grid | 👶 | | $+0.00$ | GridPopulation_works_as_expected_for_GSF_models | | Grid | 👶 | | $+0.00$ | GridPopulation_works_as_expected_for_Longitudinal_models | | Grid | 👶 | | $+42.34$ | Grid_objects_work_with_QuantityGenerator_and_QuantityCollapser | | Grid | 👶 | | $+0.00$ | coalesceGridTime_works_as_expected | | Grid | 👶 | | $+0.00$ | subjects_to_list_works_as_expected | | GridPrediction | 💔 | $3.16$ | $+161.15$ | GridPrediction_works_as_expected_for_Survival_models | | JointModelSamples | 💔 | $1.26$ | $+35.71$ | print_works_as_expected_for_JointModelSamples | | LinkComponent | 💔 | $1.76$ | $+1.46$ | all_link_files_pass_stan_s_syntax_checker | | LongitudinalGSF | 💔 | $0.31$ | $+1.73$ | LongitudinalGSF_works_as_expected_with_default_arguments | | LongitudinalQuantiles | 💔 | $20.44$ | $+24.55$ | Test_that_LongitudinalQuantities_works_as_expected | | LongitudinalRandomSlope | 💚 | $2.70$ | $-2.68$ | Print_method_for_LongitudinalRandomSlope_works_as_expected | | SimSurvival | 💔 | $0.12$ | $+3.72$ | SimSurvivalExponential_creates_a_dataset_with_the_correct_parameter | | SurvivalExponential | 💔 | $6.53$ | $+23.59$ | SurvivalExponential_can_recover_true_parameter_including_covariates_ | | SurvivalLoglogistic | 💔 | $0.15$ | $+1.79$ | sim_os_loglogistic_is_consistant_with_flexsurv | | SurvivalQuantities | 💔 | $8.89$ | $+8.54$ | SurvivalQuantities_and_autoplot.SurvivalQuantities_works_as_expected | | SurvivalWeibullPH | 💔 | $7.27$ | $+23.52$ | Print_method_for_SurvivalWeibullPH_works_as_expected | | brierScore | 💔 | $2.53$ | $+3.40$ | brierScore_SurvivalQuantities_returns_same_results_as_survreg | | compile | 💔 | $5.41$ | $+9.72$ | compileStanModel_doesn_t_error_if_the_directory_doesn_t_exist | | extract_quantities | 💔 | $0.38$ | $+7.03$ | extract_quantities_works_as_expected | | model_multi_chain | 💔 | $3.84$ | $+37.20$ | Can_recover_known_distribution_parameters_from_random_slope_model_when_using_multiple_chains | | stan_functions | 💔 | $2.30$ | $+9.33$ | GSF_SLD_function_works_as_expected |

Results for commit fb3d36b682b8818a93a0921812967e9f9e3434d8

♻️ This comment has been updated with latest results.