cmlegault / IBMWG

Index Based Methods Working Group
0 stars 1 forks source link

implementation error in manuscript #59

Closed JDeroba closed 2 years ago

JDeroba commented 2 years ago

The overview section of the methods section currently says that catches were removed from the population with some degree of implementation error (i.e., removals do not exactly equal TAC). I'm not even sure this statement is true let alone what the level of implementation error is. Can somebody that knows the code better take and look and revise the manuscript as needed? @cmlegault @timjmiller @John-Wiedenmann

timjmiller commented 2 years ago

That is true at least for the retro scenarios due to missing catch.

On Wed, Jan 5, 2022 at 12:18 PM JDeroba @.***> wrote:

The overview section of the methods section currently says that catches were removed from the population with some degree of implementation error (i.e., removals do not exactly equal TAC). I'm not even sure this statement is true let alone what the level of implementation error is. Can somebody that knows the code better take and look and revise the manuscript as needed? @cmlegault https://github.com/cmlegault @timjmiller https://github.com/timjmiller @John-Wiedenmann https://github.com/John-Wiedenmann

— Reply to this email directly, view it on GitHub https://github.com/cmlegault/IBMWG/issues/59, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEIGN7EYCKMS3PIEYOMESBDUUR4OVANCNFSM5LKNKLCQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you were mentioned.Message ID: @.***>

-- Timothy J. Miller, PhD (he, him, his) Research Fishery Biologist NOAA, Northeast Fisheries Science Center Woods Hole, MA 508-495-2365

JDeroba commented 2 years ago

The implementation error that I'm referencing would've been applied in all scenarios. It is typically applied as a lognormal error to the F that produces the TAC: F_realized = F_tac*exp(error); error~N(0,sigma). Sounds like we did not do this so I'll delete it from the manuscript. In most cases, but not all, this type of implementation error does not have a major effect on results. A reviewer like Andre might be shrewd enough to ask about it, however, as it is considered best practice to include implementation errors in MSE. I think we could argue that aside from unreported catch, our catch monitoring systems are effective enough as to make the degree of implementation error moot. A reviewer might ask us to do a spot check, but we'll worry about that when it happens.