CredentialEngine / Schema-Development

Development of the vocabularies for the CTI models
14 stars 8 forks source link

Rubric Domain Model and Terms Proposal. #892

Closed jeannekitchens closed 1 year ago

jeannekitchens commented 1 year ago

This replaces closed issue #530. Also see the CTDL Rubric Github Repository for more information.

Draft CTDL Rubric Terms Proposal

CTDL Rubric Domain Model 21-Aug-2023 drawio

CTDL Rubric-Simplified drawio

siuc-nate commented 1 year ago

Terms proposal, based on https://docs.google.com/document/d/15ZXhI4jC-u5NKcuc4yRPz4SzjNoTAaf725HZHsB2_gY/edit

CTDL Changes

rdf:Property Changes

Create rdf:Property - ceterms:hasRubric

Term Status - vs:unstable Label - "Has Rubric" Definition - "Rubric related to this resource." Domain Includes - ceterms:AssessmentProfile, ceterms:Job, ceterms:LearningOpportunityProfile, ceterms:Course, ceterms:LearningProgram, ceterms:ApprenticeshipCertificate, ceterms:AssociateDegree, ceterms:AssociateOfAppliedArtsDegree, ceterms:AssociateOfAppliedScienceDegree, ceterms:AssociateOfArtsDegree, ceterms:AssociateOfScienceDegree, ceterms:BachelorDegree, ceterms:BachelorOfArtsDegree, ceterms:BachelorOfScienceDegree, ceterms:Badge, ceterms:Certificate, ceterms:CertificateOfCompletion, ceterms:Certification, ceterms:Credential, ceterms:Degree, ceterms:DigitalBadge, ceterms:Diploma, ceterms:DoctoralDegree, ceterms:GeneralEducationDevelopment, ceterms:JourneymanCertificate, ceterms:License, ceterms:MasterCertificate, ceterms:MasterDegree, ceterms:MasterOfArtsDegree, ceterms:MasterOfScienceDegree, ceterms:MicroCredential, ceterms:OpenBadge, ceterms:ProfessionalDoctorate, ceterms:QualityAssuranceCredential, ceterms:ResearchDoctorate, ceterms:SecondarySchoolDiploma, ceterms:SpecialistDegree, ceterms:Task Range Includes - ceasn:Rubric

Modify rdf:Property - ceterms:administrationProcess

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:administrationProcess

Remove rdfs:comment - "Entity describing the process by which a credential, assessment, organization, or aspects of it, are administered." Add rdfs:comment - "Entity describing the process by which a resource, or aspects of it, are administered." Add vann:usageNote - "For assessments and rubrics, this can be used to indicate the scoring algorithm."

Modify rdf:Property - ceterms:audienceLevelType

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:audienceLevelType

Remove rdfs:comment - "Type of level indicating a point in a progression through an educational or training context, for which the credential is intended; select from an existing enumeration of such types." Add rdfs:comment - "Type of level indicating a point in a progression through an educational or training context, for which the resource is intended; select from an existing enumeration of such types."

Modify rdf:Property - ceterms:audienceType

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:classification

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:ctid

Add schema:domainIncludes - ceasn:Rubric Add schema:domainIncludes - ceasn:RubricCriterion

Modify rdf:Property - ceterms:deliveryType

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:identifier

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:industryType

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:instructionalProgramType

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:latestVersion

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:latestVersion

Remove rdfs:comment - "Latest version of the credential." Add rdfs:comment - "Latest version of the resource."

Modify rdf:Property - ceterms:lifeCycleStatusType

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:nextVersion

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:occupationType

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:offeredIn

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:previousVersion

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:subject

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:subjectWebpage

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:targetCompetency

Add schema:domainIncludes - ceasn:RubricCriterion Remove rdfs:comment - "A competency relevant to the condition being described." Add rdfs:comment - "A competency relevant to the resource being described."

Modify rdf:Property - ceterms:targetOccupation

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceterms:targetTask

Add schema:domainIncludes - ceasn:RubricCriterion

Modify rdf:Property - ceterms:versionIdentifier

Add schema:domainIncludes - ceasn:Rubric Remove rdfs:comment - "Alphanumeric identifier of the version of the credential that is unique within the organizational context of its owner." Add rdfs:comment - "Alphanumeric identifier of the version of the resource that is unique within the organizational context of its owner." Remove dct:description - "The credential version captured here is any local identifier used by the credential owner to identify the version of the credential in the its local system." Add dct:description - "The resource version captured here is any local identifier used by the resource owner to identify the version of the resource in the local system."

CTDL-ASN Changes

rdfs:Class Changes

Create rdfs:Class - ceasn:CriterionLevel

Term Status - vs:unstable Label - "Criterion Level" Definition - "An individual component or specific element within a criterion that defines a particular aspect or standard for evaluation."

Create rdfs:Class - ceasn:Rubric

Term Status - vs:unstable Label - "Rubric" Definition - "A structured and systematic evaluation tool used to assess performance, quality, and/or criteria." Equivalent Class - asn:Rubric

Create rdfs:Class - ceasn:RubricCriterion

Term Status - vs:unstable Label - "Rubric Criterion" Definition - "Resource providing explicit criteria for ensuring specific and measurable evaluation." Equivalent Class - asn:RubricCriterion

Create rdfs:Class - ceasn:RubricLevel

Term Status - vs:unstable Label - "Rubric Level" Definition - "Level or quality indicator used with Rubric Criteria."

rdf:Property Changes

Create rdf:Property - ceasn:benchmarkLabel

Term Status - vs:unstable Label - "Benchmark Label" Definition - "Label for the level achieved as defined by the Rubric Criterion." Domain Includes - ceasn:CriterionLevel Range Includes - rdf:langString

Create rdf:Property - ceasn:benchmarkText

Term Status - vs:unstable Label - "Benchmark Text" Definition - "Description of the level achieved as defined by the Rubric Criterion." Domain Includes - ceasn:CriterionLevel Range Includes - rdf:langString

Create rdf:Property - ceasn:evaluatorType

Term Status - vs:unstable Label - "Evaluator Type" Definition - "Type of evaluator; select from an existing enumeration of such types." Domain Includes - ceasn:Rubric Range Includes - skos:Concept Target Concept Scheme - ceasn:EvaluatorCategory

Create rdf:Property - ceasn:feedback

Term Status - vs:unstable Label - "Feedback" Definition - "Predefined feedback text for the benefit of the subject being evaluated." Comment - "This may include guidance and suggestions for improvement or development." Domain Includes - ceasn:CriterionLevel Range Includes - rdf:langString

Create rdf:Property - ceasn:hasCriterionCategory

Term Status - vs:unstable Label - "Has Criterion Category" Definition - "Indicates a Concept for clustering logical sets of Rubric Criteria." Domain Includes - ceasn:RubricCriterion Range Includes - skos:Concept

Create rdf:Property - ceasn:hasCriterionCategorySet

Term Status - vs:unstable Label - "Has Criterion Category Set" Definition - "Indicates the Concept Scheme for clustering logical sets of Rubric Criteria." Domain Includes - ceasn:Rubric Range Includes - skos:ConceptScheme

Create rdf:Property - ceasn:hasCriterionLevel

Term Status - vs:unstable Label - "Has Criterion Level" Definition - "Criterion Level for this resource." Domain Includes - ceasn:RubricCriterion, ceasn:RubricLevel, ceasn:CriterionLevel Range Includes - ceasn:CriterionLevel

Create rdf:Property - ceasn:hasRubricCriterion

Term Status - vs:unstable Label - "Has Rubric Criterion" Definition - "Explicit criterion for ensuring specific and measurable evaluation." Domain Includes - ceasn:Rubric Range Includes - ceasn:RubricCriterion Subproperty Of - asn:hasCriterion

Create rdf:Property - ceasn:hasRubricLevel

Term Status - vs:unstable Label - "Has Rubric Level" Definition - "Resource describing a level or quality indicator used with Rubric Criteria." Domain Includes - ceasn:Rubric Range Includes - ceasn:RubricLevel

Create rdf:Property - ceasn:hasScope

Term Status - vs:unstable Label - "Has Scope" Definition - "Description of what the rubric's creator intended to assess or evaluate." Equivalent Property - asn:hasScope Domain Includes - ceasn:Rubric Range Includes - rdf:langString

Create rdf:Property - ceasn:isBinaryEvaluation

Term Status - vs:unstable Label - "Is Binary Evaluation" Definition - "Indicates whether the criterion level is evaluated as having been met or not." Usage Note - "A value of true does not mean the subject of evaluation has met this criterion level; it means that the criterion level itself only permits a binary evaluation such as "pass/fail", "checked/unchecked", "yes/no", and so on." Domain Includes - ceasn:CriterionLevel Range Includes - xsd:boolean

Modify rdf:Property - asn:hasProgressionLevel

Add schema:domainIncludes - ceasn:Rubric Add schema:domainIncludes - ceasn:RubricCriterion Add schema:domainIncludes - ceasn:RubricLevel

Modify rdf:Property - asn:hasProgressionModel

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceasn:altCodedNotation

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceasn:codedNotation

Add schema:domainIncludes - ceasn:Rubric Add schema:domainIncludes - ceasn:RubricCriterion Add schema:domainIncludes - ceasn:RubricLevel Add schema:domainIncludes - ceasn:CriterionLevel

Modify rdf:Property - ceasn:conceptKeyword

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceasn:creator

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceasn:dateCopyrighted

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceasn:dateCreated

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceasn:dateModified

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceasn:dateValidFrom

Add schema:domainIncludes - ceasn:Rubric Remove rdfs:comment - "Beginning date of validity of this competency framework." Add dct:description - "Beginning date of validity of this resource." Remove vann:usageNote - "Where the competency document is valid for a given period of time, use both the dateValidFrom and dateValidUntil properties." Add vann:usageNote - "Where the resource is valid for a given period of time, use both the dateValidFrom and dateValidUntil properties."

Modify rdf:Property - ceasn:dateValidUntil

Add schema:domainIncludes - ceasn:Rubric Remove rdfs:comment - "End date of validity of this competency framework." Add rdfs:comment - "End date of validity of this resource." Remove vann:usageNote - "Where the competency document is valid for a given period of time, use both the dateValidFrom and dateValidUntil properties." Add vann:usageNote - "Where the resource is valid for a given period of time, use both the dateValidFrom and dateValidUntil properties."

Modify rdf:Property - ceasn:derivedFrom

Add schema:domainIncludes - ceasn:Rubric Add schema:rangeIncludes - ceasn:Rubric

Modify rdf:Property - ceasn:description

Add schema:domainIncludes - ceasn:Rubric Add schema:domainIncludes - ceasn:RubricCriterion Add schema:domainIncludes - ceasn:RubricLevel

Modify rdf:Property - ceasn:educationLevelType

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceasn:inLanguage

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceasn:license

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceasn:listID

Add schema:domainIncludes - ceasn:RubricCriterion Add schema:domainIncludes - ceasn:RubricLevel Add schema:domainIncludes - ceasn:CriterionLevel

Modify rdf:Property - ceasn:name

Add schema:domainIncludes - ceasn:Rubric Add schema:domainIncludes - ceasn:RubricCriterion Add schema:domainIncludes - ceasn:RubricLevel

Modify rdf:Property - ceasn:publicationStatusType

Add schema:domainIncludes - ceasn:Rubric Remove rdfs:comment - "The publication status of the of this resource." Add rdfs:comment - "The publication status of the resource."

Modify rdf:Property - ceasn:publisher

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceasn:publisherName

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceasn:rights

Add schema:domainIncludes - ceasn:Rubric

Modify rdf:Property - ceasn:weight

Add schema:domainIncludes - ceasn:RubricCriterion

skos:ConceptScheme Changes

Create skos:ConceptScheme - ceasn:EvaluatorCategory

Term Status - vs:unstable Label - "Evaluator Category" Definition - "Category of agents that perform evaluation."

skos:Concept Changes

Create skos:Concept - evalCat:Authority

Term Status - vs:unstable In Scheme - ceasn:EvaluatorCategory Preferred Label - "Authority" Definition - "Evaluator is an agent with authority over the person, group, or thing being evaluated in the relevant context." Comment - "Examples include teachers, supervisors, managers, or others with positions over the person or group being evaluated."

Create skos:Concept - evalCat:Automated

Term Status - vs:unstable In Scheme - ceasn:EvaluatorCategory Preferred Label - "Automated" Definition - "Evaluator is an automated agent or process."

Create skos:Concept - evalCat:External

Term Status - vs:unstable In Scheme - ceasn:EvaluatorCategory Preferred Label - "External" Definition - "Evaluator is an agent who is outside the context of the person, group, or thing being evaluated." Comment - "Evaluator is typically independent of the person, group, or thing being evaluated."

Create skos:Concept - evalCat:Peer

Term Status - vs:unstable In Scheme - ceasn:EvaluatorCategory Preferred Label - "Peer" Definition - "Evaluator is one or more peers of the person, group, or thing being evaluated." Comment - "Peers may be people taking the same course or in similar job roles."

Create skos:Concept - evalCat:Self

Term Status - vs:unstable In Scheme - ceasn:EvaluatorCategory Preferred Label - "Self" Definition - "Evaluator is the person or group being evaluated."

QData Changes

rdf:Property Changes

Create rdf:Property - qdata:maxPercentage

Term Status - vs:unstable Label - "Max Percentage" Definition - "The upper percentage of some characteristic or property." Usage Note - "Best practice is to treat the value of this property as a verbatim percentage; for example, a value of 1.5 should be interpreted as 1.5%" Domain Includes - ceasn:CriterionLevel, schema:QuantitativeValue, ceterms:ValueProfile Range Includes - xsd:float

Create rdf:Property - qdata:minPercentage

Term Status - vs:unstable Label - "Min Percentage" Definition - "The lower percentage of some characteristic or property." Usage Note - "Best practice is to treat the value of this property as a verbatim percentage; for example, a value of 1.5 should be interpreted as 1.5%" Domain Includes - ceasn:CriterionLevel, schema:QuantitativeValue, ceterms:ValueProfile Range Includes - xsd:float

Modify rdf:Property - qdata:percentage

Add schema:domainIncludes - ceasn:CriterionLevel

Modify rdf:Property - schema:maxValue

Add schema:domainIncludes - ceasn:CriterionLevel

Modify rdf:Property - schema:minValue

Add schema:domainIncludes - ceasn:CriterionLevel

Modify rdf:Property - schema:value

Add schema:domainIncludes - ceasn:CriterionLevel

philbarker commented 1 year ago

Noting that the schema:isBasedOn alignments to asn terms are not included, presumably because there is no way of adding them yet.

philbarker commented 1 year ago

@siuc-nate @jeannekitchens Comparing to Domain model diagram I find these differences (which may be intentional changes missed from the domain model diagram or errors in the proposal doc):

philbarker commented 1 year ago

Q for @siuc-nate qdata:maxPercentage usage note says: "Best practice is to treat the value of this property as a verbatim percentage; for example, a value of 1.5 should be interpreted as 1.5%" but the code examples (e.g. Moodle have

"qdata:percentage": 1.0

for 100%. Assuming best practice for qdata:percentage and qdata:maxPercentage should be the same, where's the error?

philbarker commented 1 year ago

Error in EvalCat

siuc-nate commented 1 year ago

Per our 2023-9-8 meeting:

schema:isBasedOn

Will address this when I get a chance to update the schema manager to support it.

qdata:minPercentage/qdata:maxPercentage

Agree all of the percentage properties should work the same way. We just need to fix the examples.

Other properties

Fixed. Note that we also decided to use asn:hasProgressionLevel with ceasn:RubricLevel and ceasn:RubricCriterion instead of with ceasn:CriterionLevel.

Which classes should have ceterms:ctid

siuc-nate commented 1 year ago

To clean up some things, I split out the changes by schema, and regenerated the change data in this post and in this turtle file

siuc-nate commented 1 year ago

These changes have been made in the pending schemas and noted in the history tracking.

siuc-nate commented 1 year ago

Per our 2023-10-17 meeting: We have decided to drop ceasn:isBinaryEvaluation entirely, as it appears it may not be necessary after all. If needed, we can explore bringing it back. Since the property is unstable, it won't be kept as a deprecated property.