Funnel plot
Type of graph used in research
title: "Funnel plot" type: doc version: 1 created: 2026-02-28 author: "Wikipedia contributors" status: active scope: public tags: ["statistical-charts-and-diagrams", "meta-analysis", "systematic-review"] description: "Type of graph used in research" topic_path: "general/statistical-charts-and-diagrams" source: "https://en.wikipedia.org/wiki/Funnel_plot" license: "CC BY-SA 4.0" wikipedia_page_id: 0 wikipedia_revision_id: 0
::summary Type of graph used in research ::
::figure[src="https://upload.wikimedia.org/wikipedia/commons/2/2c/Funnelplot.png" caption="precision]] (e.g. the inverse standard error or number of experimental subjects) and the ''x''-axis shows the study's result (e.g. the drug's measured average effect)."] ::
A funnel plot is a graph designed to check for the existence of publication bias; funnel plots are commonly used in systematic reviews and meta-analyses. In the absence of publication bias, it assumes that studies with high precision will be plotted near the average, and studies with low precision will be spread evenly on both sides of the average, creating a roughly funnel-shaped distribution. Deviation from this shape can indicate publication bias.
Quotation
Funnel plots, introduced by Light and Pillemer in 1984{{Cite book | author1 = R. J. Light | author2 = D. B. Pillemer | title = Summing up: The Science of Reviewing Research | publisher = Harvard University Press | year = 1984 | location = Cambridge, Massachusetts. | isbn = 978-0-674-85431-4 | url-access = registration | url = https://archive.org/details/summingupscience00ligh and discussed in detail by Matthias Egger and colleagues,{{Cite journal | author = Matthias Egger, G. Davey Smith, M. Schneider & C. Minder | title = Bias in meta-analysis detected by a simple, graphical test | journal = BMJ | volume = 315 | issue = 7109 | pages = 629–634 |date=September 1997 | pmid = 9310563 | url= | pmc = 2127453 | doi=10.1136/bmj.315.7109.629 |author1=Jonathan A. C. Sterne |author2=Matthias Egger | title = Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis | journal = Journal of Clinical Epidemiology | volume = 54 | issue = 10 | pages = 1046–55 |date=October 2001 | pmid = 11576817 | doi = 10.1016/S0895-4356(01)00377-8 are useful adjuncts to meta-analyses. A funnel plot is a scatterplot of treatment effect against a measure of study precision. It is used primarily as a visual aid for detecting bias or systematic heterogeneity. A symmetric inverted funnel shape arises from a 'well-behaved' data set, in which publication bias is unlikely. An asymmetric funnel indicates a relationship between treatment effect estimate and study precision. This suggests the possibility of either publication bias or a systematic difference between studies of higher and lower precision (typically 'small study effects'). Asymmetry can also arise from use of an inappropriate effect measure. Whatever the cause, an asymmetric funnel plot leads to doubts over the appropriateness of a simple meta-analysis and suggests that there needs to be investigation of possible causes.
A variety of choices of measures of 'study precision' is available, including total sample size, standard error of the treatment effect, and inverse variance of the treatment effect (weight). Sterne and Egger have compared these with others, and conclude that the standard error is to be recommended. When the standard error is used, straight lines may be drawn to define a region within which 95% of points might lie in the absence of both heterogeneity and publication bias.
In common with confidence interval plots, funnel plots are conventionally drawn with the treatment effect measure on the horizontal axis, so that study precision appears on the vertical axis, breaking with the general rule. Since funnel plots are principally visual aids for detecting asymmetry along the treatment effect axis, this makes them considerably easier to interpret.
Criticism
The funnel plot is not without problems. If high-precision studies are different from low-precision studies with respect to effect size (e.g., due to different populations examined) a funnel plot may give a wrong impression of publication bias.{{Cite journal | author = Joseph Lau, John P. A. Ioannidis, Norma Terrin, Christopher H. Schmid & Ingram Olkin | title = The case of the misleading funnel plot | journal = BMJ | volume = 333 | issue = 7568 | pages = 597–600 |date=September 2006 | doi = 10.1136/bmj.333.7568.597 | pmid = 16974018 | pmc = 1570006 The appearance of the funnel plot can change quite dramatically depending on the scale on the y-axis — whether it is the inverse square error or the trial size.{{Cite journal |author1=Jin-Ling Tang |author2=Joseph LY Liu | title = Misleading funnel plot for detection of bias in meta-analysis | journal = Journal of Clinical Epidemiology | volume = 53 | issue = 5 |date=May 2000 | pages = 477–484 | doi = 10.1016/S0895-4356(99)00204-8 | pmid=10812319
References
References
- (2005). "In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias". Journal of Clinical Epidemiology.
::callout[type=info title="Wikipedia Source"] This article was imported from Wikipedia and is available under the Creative Commons Attribution-ShareAlike 4.0 License. Content has been adapted to SurfDoc format. Original contributors can be found on the article history page. ::