search

Ledgerback / DGSF

An open and participatory framework to re-define how organizations assess their alignment with Decentralized Autonomous Organizations (DAOs).
https://joan816.softr.app/
2 stars 0 forks source link

Provide feedback for each question #15

Open vincenzospaghetti opened 3 months ago

vincenzospaghetti commented 3 months ago

Assigned To:

Objective:

Information to Review:

Links:

Questions from Task Creator (if any):

linxule commented 3 months ago

@kylefox1 do you have a dedicated Airtable base or equivalent where we can leave comments?

Alternatively, we can leverage the base that I created. But I'm unclear if the original questions are up to date.

kylefox1 commented 3 months ago

@kylefox1 do you have a dedicated Airtable base or equivalent where we can leave comments?

Yes. Please refer to the Questionnaire-V09 table in the DGSF-DAO_Index-Resources-2024_03_07 base on NocoDB.

linxule commented 3 months ago

@kylefox1 do you have a dedicated Airtable base or equivalent where we can leave comments?

Yes. Please refer to the Questionnaire-V09 table in the DGSF-DAO_Index-Resources-2024_03_07 base on NocoDB.

Can you attach the links in your reply? Many thanks

kylefox1 commented 3 months ago

@kylefox1 do you have a dedicated Airtable base or equivalent where we can leave comments?

Yes. Please refer to the Questionnaire-V09 table in the _DGSF-DAO_Index-Resources-2024_0307 base on NocoDB.

Can you attach the links in your reply? Many thanks

You can find the base here: https://data.ledgerback.xyz/dashboard/#/base/cea9c5a9-4b76-4478-b9d5-f0f83d941939

kylefox1 commented 3 months ago

Should I add a form for assessing the question's content validity, based on a 3-point "scale of 'not necessary', 'helpful but not essential', and 'essential'", and a form for a "4-point scale for relevance, clarity, ambiguity, and simplicity (from 1: not relevant, not simple, doubtful, not clear to 4: extremely relevant, extremely simple, meaningful, very clear)"?

Reference:

  1. A Novel Scale for Evaluating Digital Readiness toward Earthquakes: A Comprehensive Validity and Reliability Analysis

To further evaluate the scale’s content validity, each item was evaluated during the quantitative phase using the content validity ratio (CVR) and content validity index (CVI). To calculate the CVR, experts were asked to assign each item a score between 1 and 3 on a scale of “not necessary”, “helpful but not essential”, and “essential”, respectively. Each item was acceptable if its CVR exceeded Lawshe’s requirements; otherwise, it was removed. Using Lawshe’s threshold, the crucial CVR value for 9 experts was 0.78 [39]. The item content validity index (I-CVI) and scale content validity (S-CVI/Ave) were then examined using a 4-point scale for relevance, clarity, ambiguity, and simplicity (from 1: not relevant, not simple, doubtful, not clear to 4: extremely relevant, extremely simple, meaningful, very clear) [40,41,42]. An I-CVI of 0.78 or above was regarded as acceptable, whereas values below 0.7 were ruled unsuitable and hence removed, and lastly, values outside this range were corrected [41,43,44]. Acceptable S-CVI/Ave values as the averages of all I-CVIs were more than or equal to 0.90.

linxule commented 3 months ago

Whatever works for you. A framework like this could help me examine the questions more closely. But, I would say feedback on questions would need explanation too, going beyond the simple scale. And most importantly, we would need suggestions on how to improve the questions.

kylefox1 commented 3 months ago

Whatever works for you. A framework like this could help me examine the questions more closely. But, I would say feedback on questions would need explanation too, going beyond the simple scale.

I think adding a field for free form text could suffice then.

vincenzospaghetti commented 3 months ago

@kylefox1 are you wanting us to review just these questions: https://data.ledgerback.xyz/dashboard/#/base/cea9c5a9-4b76-4478-b9d5-f0f83d941939/mbm3gnind0gl9h8

kylefox1 commented 3 months ago

@kylefox1 are you wanting us to review just these questions: https://data.ledgerback.xyz/dashboard/#/base/cea9c5a9-4b76-4478-b9d5-f0f83d941939/mbm3gnind0gl9h8

Yes. Please use that table to add your comments on the questions.

linxule commented 3 months ago

@kylefox1 can you give us edit access? I don't see an option to add columns or edit text at the moment.

kylefox1 commented 3 months ago

@kylefox1 can you give us edit access? I don't see an option to add columns or edit text at the moment.

You should have access. Make sure to login to data.ledgerback.xyz, and then look for the DGSF-DAO_Index-Resources-2024_03_07 base.