search

FAIRplus / FAIRPlus_squad2

an internal issue tracker (=todo list) for Squad team 2
3 stars 0 forks source link

Develop an automated test under FAIR evaluator for ontology coverage assessment #45

Open mcourtot opened 4 years ago

mcourtot commented 4 years ago

Write a test for the metric using Wilkinson tool that can be assessed against the proteomics dataset. Maybe create FAIRPlus collection of metrics at same time?

mcourtot commented 4 years ago

See https://fairsharing.github.io/FAIR-Evaluator-FrontEnd/#!/evaluations/170 for the existing evaluation of the transcriptomics

We need to see if we can write a test for a specific metric (eg Cellosaurus IDs on transcriptomics dataset) and possibly create a FAIRPlus transcriptomics collection. If we can't we need to feedback to Mark and Michel that we need support for using the tool

FuqiX commented 4 years ago

@JolandaS and @rgiessmann have discussed about this. Robert has more expertise in writing automatic tests. Need to check if what can be measured from the UC2. Also need to compare different evaluators. The FAIRplus tests can be added to the FAIR evaluator GH. Nick suggested the tests can be very dataset-specific. Chris suggested some indicators are more important for certain dataset.