print AIC, BIC in output; also print `B`

ICTatRTI / PersonAlyticsPower

PersonAlyticsPower: Power Analysis and Simulation for PersonAlytics

0 stars 1 forks source link

print AIC, BIC in output; also print `B` #10

Closed stueller closed 2 years ago

stueller commented 2 years ago

Fit statistics allow users to compare the same run with different models. Printing B serves as a check that the number of bootstrap replications requested is correctly passed from the GUI to PersonAlytic.

stueller commented 2 years ago

This first needs to be implemented in PersonAlytics, see https://github.com/ICTatRTI/PersonAlytics/issues/30

stueller commented 2 years ago

LL, DF, AIC, and BIC are being output from PersonAlytic. In ICTpower.R, augment powerReport() to summarizes these fit statistics, the GUI should be able to print them in the existing output format without changes on the GUI side.

include both average AIC and a bootstrap CI. This will allow users to compare two runs and test whether they have power to detect between two different models fit to the same inputMat.
paout will now have $LL, $DF, $AIC, and $BIC
use the package coxed to get the bca() function; coxed will need to be added to the DESCRIPTION file
add new code below the line # select whichV based on FPC

stueller commented 2 years ago

We are changing SD Estimates to SE Estimates (@jon-holt make this change), which is correct as B->Inf and if the model is correct. This nuance will be captured using the following note (@jon-holt add this to the output using cat()):

cat("\n'Mean Estimates' is the average of the", B, "replications.",
    "\n'SE Estimates' is the standard deviation of the", B, "replications ",
    "\n    and will equal the population standard error when B is large and the",
    "\n    model is correct.",
    "\n'Power' is the estimated statistical power, or the proportion of the",
    "\n    ", B, "replications where p <= ", alpha, ".")