write wrapper function like `hubEvals::score_mdl_output()` - Githubissues

hubverse-org / hubEvals

https://hubverse-org.github.io/hubEvals/

Other

1 stars 0 forks source link

write wrapper function like `hubEvals::score_mdl_output()` #13

Open nickreich opened 5 months ago

nickreich commented 5 months ago

input: hubverse model_output_tbl, target_data, rules (optional), scale (c("identity", "log")), ...
- action: check to ensure that all data are one output_type
- action: translate model_output data to scoringutils objects
- action: transform scoringutils object if specified
- action: call scoringutils::score()
- (action: validate that rules can be applied to the model_output data type provided)
output: data.table or scores object containing the scores

migrated from https://github.com/epiforecasts/scoringutils/issues/605

nickreich commented 5 months ago

Noting that this will require some standard understanding of hubverse target data, discussed here.

elray1 commented 4 months ago

would be nice if the name of this function omitted the same set of characters as model_out_tbl (include vowels in "model", drop "put")

nickreich commented 3 months ago

Noting that per this comment, we could assume a specific structure for the target data.