CRSU-Apps / MetaInsight

An interactive web-based tool for analyzing, interrogating, and visualizing network meta-analyses using R-shiny
https://crsu.shinyapps.io/MetaInsight/
GNU General Public License v3.0
10 stars 9 forks source link

Investigate "data points" for trials with no events in any arm #72

Open tommorris168 opened 1 year ago

tommorris168 commented 1 year ago

In the binary model, when a trial has no events in any of its arms, a warning is displayed on the 1c. Network Plot tab: Screenshot 2023-09-07 151922

Removing the offending trial in the sensitivity analysis options removes the warning from the sensitivity model (but not from the main model). When running the main (Bayesian) analysis and the sensitivity analysis, the model statistics are different, including the number of "data points": Screenshot 2023-09-07 152134

According to the warning, the dropped trial is "not considered in network meta-analysis". In that case I would expect the data points (and the other statistics) to be the same. They are the same in the frequentist model, but not the Bayesian. For the other statistics this can be explained by Bayesian randomness, but that doesn't explain the difference in data points.

The first step to resolving this is to find out how trials with no events in any arm are handled in gemtc.

nabury commented 1 year ago

Could you add the file you've used and the options chosen in the app so that I can reproduce this?

tommorris168 commented 1 year ago

Dataset here: Data points and no events problem.csv

BalancedmonkeY commented 1 year ago

Summary information on tab 1c is created using netconnection() which is part of the {netmeta} package. For conducting an NMA using the {netmeta} package, if both arms of a two-arm study have 0 outcome, the entire study will be removed from the frequentist analysis -> hence the warning from netconnection()

However, the Bayesian analysis does allow studies with zeros in every arm -> hence the inclusion of all the data points.

So the differing information is because of the differences between packages.

Action-> It should be put somewhere on tab 1c that the warning about removed studies is only applicable to the frequentist analysis (or similar)