Novel methods to deal with publication biases : secondary analysis of antidepressant trials in the FDA trial registry database and related journal publications

Moreno, Santiago G. and Sutton, Alex J. and Turner, Erick H. and Abrams, Keith R. and Cooper, Nicola J. and Palmer, Tom M. and Ades, A. E. (2009) Novel methods to deal with publication biases : secondary analysis of antidepressant trials in the FDA trial registry database and related journal publications. BMJ, 339: b2981. ISSN 0959-8138

Abstract

OBJECTIVE: To assess the performance of novel contour enhanced funnel plots and a regression based adjustment method to detect and adjust for publication biases. DESIGN: Secondary analysis of a published systematic literature review. DATA SOURCES: Placebo controlled trials of antidepressants previously submitted to the US Food and Drug Administration (FDA) and matching journal publications. METHODS: Publication biases were identified using novel contour enhanced funnel plots, a regression based adjustment method, Egger's test, and the trim and fill method. Results were compared with a meta-analysis of the gold standard data submitted to the FDA. RESULTS: Severe asymmetry was observed in the contour enhanced funnel plot that appeared to be heavily influenced by the statistical significance of results, suggesting publication biases as the cause of the asymmetry. Applying the regression based adjustment method to the journal data produced a similar pooled effect to that observed by a meta-analysis of the FDA data. Contrasting journal and FDA results suggested that, in addition to other deviations from study protocol, switching from an intention to treat analysis to a per protocol one would contribute to the observed discrepancies between the journal and FDA results. CONCLUSION: Novel contour enhanced funnel plots and a regression based adjustment method worked convincingly and might have an important part to play in combating publication biases.