iRNA-COSI / APAeval

Community effort to evaluate computational methods for the detection and quantification of poly(A) sites and estimating their differential usage across RNA-seq samples
MIT License
13 stars 14 forks source link

Quantification summary workflow: Include all considered metrics #324

Closed faricazjj closed 2 years ago

faricazjj commented 2 years ago

Credits to @ninsch3000 for putting together this list of suggested metrics by @mrgazzara , @dominikburri , @SamBryce-Smith , @ninsch3000, and @daneckaw

We decided to add calculation of all considered metric so it'd be more convenient to pick which final metric to include in OpenEBench, or for changes in the future.

Metrics to be included are:

More to be added as needed, more discussions needed, e.g.

We discussed that we could potentially get identification summary workflow results from quantification using match_with_gt function which returns the table with matched and unmatched sites of ground truth and predicted that we can use to directly calculate identification metrics. Identification metrics to include:

dominikburri commented 2 years ago

F1 score as the harmonic mean of precision and sensitivity could be added.

ninsch3000 commented 2 years ago

Has been discussed in metrics meeting, nothing to add here, presented suggestions will be fixed with #379