isa-camss / CAV

The Core Assessment Vocabulary represents and defines what an “Assessment” of “assets” is and how to perform the assessment based on “Criteria”. It is a domain-agnostic vocabulary, meaning that it can be used to assess any type of assets.
3 stars 1 forks source link

Capturing and parsing formulae for the criterion evaluation score #3

Closed paulakeen closed 3 years ago

paulakeen commented 4 years ago

The score of an objective, i.e. non-qualitative, criteria can/should be calculated based on a formula. The current version of the CAV does not have any placeholder for formulae.

In issue #1 the proposal issued is to use the Class CriterionEvaluationContext, which points always to 1 Score to include a field 'Formula' or to link to a sub-model or sub-ontology that represents the 'Formula'.

For sure there must exist out there more than one representation of formulae an equations that can be automatically parsed, validated and processed to cast the evaluation resulting score.

QUESTION : What should we use in CAV for the representation of a formula?

Two preliminary suggestions were:

  1. Consider using the LaTex syntax for mathematical equations
  2. Consider using W3C MathML
  3. Other

(BTW, this raises another subject that should be discussed in this forum: what is the difference between evaluation and assessment? Can formulae be used for 'the calculation of an assessment'? Please feel free to comment on this other issue in Issue #4 ).

costas80 commented 3 years ago

Interesting idea but I fear that this could be a door leading to much complexity. If we start with formulae (which not all assessments would include by the way) we could be tempted to extend to things like value ranges, weights, prerequisites, sub-criteria etc. If possible I would have such details be captured (ideally) within the CCCEV (and not the CAV) or, if not possible within the CCCEV, an application profile.

I understand that this relates to the notion of evaluation vs assessment (see #4) and the precise purpose of CriterionEvaluationContext (see #1). In my view however CriterionEvaluationContext should add contextualisation (hence the "Context" suffix), extending the narrative of the scenario, but not offering something as concrete as a formula.

Looking forward to discussing this :)

paulakeen commented 3 years ago

After discusion on whether to have formulae or not in the CAV the conclusions and decisions made by the CAMSS WG are:

Somehow link the EvaluationContext to a 'resource' that can could be, amongst other things, a formula.

Proposal for further, future, discussions could be:

We need to further discuss this topic.

jseguraf commented 3 years ago

See issue #1 .