This fixes a bug occurring for bootstrapped quantities (RMSE and AUC: standard error and confidence interval) if deltas = TRUE: In that case, we need to call bootstrap() only once (thereby making use of the matrix ability of bootstrap()'s fun) instead of twice, to ensure that the bootstrap samples are the same for the submodel (or reference model) and the baseline model (which is usually the reference model). The old behavior led to the strange result that the reference model's SE could be non-zero in case of deltas = TRUE when a seed was not set via argument seed (which gets passed to bootstrap()), see below.
This fixes a bug occurring for bootstrapped quantities (RMSE and AUC: standard error and confidence interval) if
deltas = TRUE
: In that case, we need to callbootstrap()
only once (thereby making use of the matrix ability ofbootstrap()
'sfun
) instead of twice, to ensure that the bootstrap samples are the same for the submodel (or reference model) and the baseline model (which is usually the reference model). The old behavior led to the strange result that the reference model's SE could be non-zero in case ofdeltas = TRUE
when a seed was not set via argumentseed
(which gets passed tobootstrap()
), see below.Illustration:
Previously,
rmse.se
was0.02171921
andauc.se
was0.07552023
. With this PR,rmse.se
andauc.se
are both0
, as expected.