verbal-autopsy-software / openVA

R package for openVA: a suite of tools for multiple VA methods
4 stars 6 forks source link

Error with organizing output for codeVA #31

Open y-chu opened 1 year ago

y-chu commented 1 year ago

Hi team,

I ran into the following error for the first time when running InsilicoVA with codeVA (codes as below)

codeVA(input.data
              , data.type = "WHO2016", model = "InSilicoVA"
              , subpop=subpop
              , Nsim=6000, jump.scale=0.2, auto.length = TRUE
              , dir=output.dir)
Pasted Graphic 11

I solved it by increasing Nsim and having smaller jump.scale, but still not fully sure what's the real problem here.
Maybe the error message could be a bit more informative to help with debugging?

Thanks all!

rrwen commented 9 months ago

I am having the same issue running on a ~10K record dataset (nrow=11832, col=354) with Nsim=10000:

image

rrwen commented 9 months ago

Update to https://github.com/verbal-autopsy-software/openVA/issues/31#issuecomment-1910702206

It successfully ran when setting Nsim=9500, but took a little over 3 hours.

It seems most of the time was spent trying to re-iterate multiple times:

image

Final iterations:

image