cmu-delphi / exploration-tooling

tools for evaluating and exploring forecasters
Other
0 stars 0 forks source link

Support use of shiny app with external score file #36

Closed nmdefries closed 10 months ago

nmdefries commented 11 months ago

Add script to launch shiny app with scores from user-supplied RDS file. User can set path to input score file and output dir via CLI args.

Potential improvements:

dsweber2 commented 11 months ago

I don't have that strong of opinions about CLI args vs not, as long as there's a help message if the call fails.

In light of our earlier discussion about maybe having targets that do score comparisons, it'd probably be better to do this via new targets rather than directly in the shiny app, so that we can also do comparisons with the external scores.

dshemetov commented 11 months ago

docopt may be handy for doing a CLI.

nmdefries commented 10 months ago
nmdefries commented 10 months ago

Test failure appears to be because of epipredict changes. This has been fixed in https://github.com/cmu-delphi/exploration-tooling/pull/32, so will wait till that's on main and then update this branch.