Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses?

Research output: Contribution to journalJournal articleResearchpeer-review

  • Kristian Thorlund
  • P J Devereaux
  • Jørn Wetterslev
  • Gordon Guyatt
  • John P A Ioannidis
  • Lehana Thabane
  • Gluud, Lise Lotte
  • Bodil Als-Nielsen
  • Christian Gluud
BACKGROUND: Results from apparently conclusive meta-analyses may be false. A limited number of events from a few small trials and the associated random error may be under-recognized sources of spurious findings. The information size (IS, i.e. number of participants) required for a reliable and conclusive meta-analysis should be no less rigorous than the sample size of a single, optimally powered randomized clinical trial. If a meta-analysis is conducted before a sufficient IS is reached, it should be evaluated in a manner that accounts for the increased risk that the result might represent a chance finding (i.e. applying trial sequential monitoring boundaries). METHODS: We analysed 33 meta-analyses with a sufficient IS to detect a treatment effect of 15% relative risk reduction (RRR). We successively monitored the results of the meta-analyses by generating interim cumulative meta-analyses after each included trial and evaluated their results using a conventional statistical criterion (alpha = 0.05) and two-sided Lan-DeMets monitoring boundaries. We examined the proportion of false positive results and important inaccuracies in estimates of treatment effects that resulted from the two approaches. RESULTS: Using the random-effects model and final data, 12 of the meta-analyses yielded P > alpha = 0.05, and 21 yielded P alpha = 0.05. The monitoring boundaries eliminated all false positives. Important inaccuracies in estimates were observed in 6 out of 21 meta-analyses using the conventional P
Original languageEnglish
JournalInternational Journal of Epidemiology
Volume38
Issue number1
Pages (from-to)276-86
Number of pages10
ISSN0300-5771
DOIs
Publication statusPublished - 2008

Bibliographical note

Keywords: Data Interpretation, Statistical; False Positive Reactions; Humans; Meta-Analysis as Topic; Randomized Controlled Trials as Topic; Research Design; Treatment Outcome

ID: 20008288