greenelab / covid19-review

A collaborative review of the emerging COVID-19 literature. Join the chat here:
https://gitter.im/covid19-review/community
Other
116 stars 81 forks source link

New Paper (Diagnostic): The Promise and Peril of Antibody Testing for COVID-19 #287

Open rando2 opened 4 years ago

rando2 commented 4 years ago

Title: The Promise and Peril of Antibody Testing for COVID-19.

Please paste a link to the paper or a citation here:

Link: https://jamanetwork.com/journals/jama/fullarticle/2764954

What is the paper's Manubot-style citation?

Citation: [@doi:10.1001/jama.2020.6170]

Please list some keywords (3-10) that help identify the relevance of this paper to COVID-19

Which areas of expertise are particularly relevant to the paper?

Questions to answer about each paper:

Please provide 1-2 sentences introducing the study and its main findings

Study question(s) being investigated:

What type of testing scenario is being considered?

Is it a screening test (used for individuals with no symptoms), diagnostic test (used for individuals with symptoms), or definitive test (used for individuals who have had previous positive test results on diagnostic or screening tests)?

Study population:

What is the model system (e.g., human study, animal model, cell line study)?

What is the sample size?

What is the "pre-test" probability of disease in the study population (i.e., what is the anticipated prevalence of the disease?)

For human studies, the following are related to the pre-test probability:

What countries/regions are considered?
What is the age range, gender, other relevant characteristics?
What is the setting of the study (e.g., random sample of school children, retirement communities, etc.)?
What other specific inclusion-exclusion criteria are considered?

Reference test:

What reference test is considered as a "gold standard" comparator for the test under investigation?

Test assignment:

How are the new and reference tests assigned?

Examples of assignment could include: Recruited individuals have initially undergone neither the new nor the reference test; individuals tested as positive or negative by the reference test undergo the new test; individuals who have undertaken the new test are assessed by the standard test.

Are there any other relevant details about the study design?

Depending on how individuals are chosen, the test may be biasing towards more sick or less sick individuals or very clear-cut positive/negative cases. Any factors that would influence this bias should be included here.

Test conduct:

How were tests performed?

Describe technical details of assays used, when measurements were taken and by whom, etc. for both the new and standard tests.

Test Assessment

Describe how individuals are classified as positive or negative, e.g. if a threshold is used.

Is there evidence that the test is precise/reproducible when repeated more than once?

Are measurements complete?

For example: Do some participants undergo just one test (the new or the reference test)? Are there individuals with inconclusive results?

Results summary:

What are the estimated sensitivity, specificity, positive predictive value (PPV), and negative predicted value (NPV)?

Note that the PPV and NPV represent "post-test" probabilities of disease and are generally more meaningful than sensitivity and specificity. Sometimes the post-test odds will be given instead.

What are the confidence bounds around these intervals?

Interpretation of results for study population:

How good is the test at ruling in or ruling out a disease based on the post-test probabilities?

Are there identified side affects of the test?

Is patient adherence to the test likely to be an issue?

Extrapolation of conclusions to other groups of individuals

How well is the test likely to work in populations with different pretest odds?

For example, if the prevalence is lower, then the PPV will also be lower, but the NPV will be higher.

How costly is the test?

How difficult is it to perform the test in different settings?

Could the test be combined with other existing tests?

Summary of reliability

1-2 sentences on concluding remarks, including summary of strengths, weaknesses, limitations.

Progress

Check off the components as they are completed. If the component is not applicable, check the box as well.

rando2 commented 4 years ago

Reviewed by Canadian medical students here