You are here

How to Make Nothing Out of Something

Title: How To Make Nothing Out Of Something: Analyses Of The Impact Of Study Sampling And Statistical Interpretation In Misleading Meta-analytic Conclusions.
117 views
21 downloads
Name(s): Cunningham, Michael R., author
Baumeister, Roy F., author
Type of Resource: text
Genre: Text
Date Issued: 2016-10-25
Physical Form: computer
online resource
Extent: 1 online resource
Language(s): English
Abstract/Description: The limited resource model states that self-control is governed by a relatively finite set of inner resources on which people draw when exerting willpower. Once self-control resources have been used up or depleted, they are less available for other self-control tasks, leading to a decrement in subsequent self-control success. The depletion effect has been studied for over 20 years, tested or extended in more than 600 studies, and supported in an independent meta-analysis (Hagger et al., 2010). Meta-analyses are supposed to reduce bias in literature reviews. Carter et al.'s (2015) meta-analysis, by contrast, included a series of questionable decisions involving sampling, methods, and data analysis. We provide quantitative analyses of key sampling issues: exclusion of many of the best depletion studies based on idiosyncratic criteria and the emphasis on mini meta-analyses with low statistical power as opposed to the overall depletion effect. We discuss two key methodological issues: failure to code for research quality, and the quantitative impact of weak studies by novice researchers. We discuss two key data analysis issues: questionable interpretation of the results of trim and fill and Funnel Plot Asymmetry test procedures, and the use and misinterpretation of the untested Precision Effect Test and Precision Effect Estimate with Standard Error (PEESE) procedures. Despite these serious problems, the Carter et al. (2015) meta-analysis results actually indicate that there is a real depletion effect contrary to their title.
Identifier: FSU_libsubv1_wos_000386097300002 (IID), 10.3389/fpsyg.2016.01639 (DOI)
Keywords: ego depletion, excess, Funnel Plot Asymmetry Test, hypothesis, limited resource, meta-analysis as topic, model, Precision Effects Test, publication bias, self-control, strength depletion, Test for Excess Significance, trim and fill
Publication Note: The publisher’s version of record is available at https://doi.org/10.3389/fpsyg.2016.01639
Persistent Link to This Record: http://purl.flvc.org/fsu/fd/FSU_libsubv1_wos_000386097300002
Owner Institution: FSU
Is Part Of: Frontiers in Psychology.
1664-1078
Issue: vol. 7

Choose the citation style.
Cunningham, M. R., & Baumeister, R. F. (2016). How To Make Nothing Out Of Something: Analyses Of The Impact Of Study Sampling And Statistical Interpretation In Misleading Meta-analytic Conclusions. Frontiers In Psychology. Retrieved from http://purl.flvc.org/fsu/fd/FSU_libsubv1_wos_000386097300002