You are here

Bias caused by sampling error in meta-analysis with small sample sizes.

Title: Bias caused by sampling error in meta-analysis with small sample sizes.
0 views
0 downloads
Name(s): Lin, Lifeng, author
Type of Resource: text
Genre: Journal Article
Text
Date Issued: 2018-09-13
Physical Form: computer
online resource
Extent: 1 online resource
Language(s): English
Abstract/Description: Meta-analyses frequently include studies with small sample sizes. Researchers usually fail to account for sampling error in the reported within-study variances; they model the observed study-specific effect sizes with the within-study variances and treat these sample variances as if they were the true variances. However, this sampling error may be influential when sample sizes are small. This article illustrates that the sampling error may lead to substantial bias in meta-analysis results. We conducted extensive simulation studies to assess the bias caused by sampling error. Meta-analyses with continuous and binary outcomes were simulated with various ranges of sample size and extents of heterogeneity. We evaluated the bias and the confidence interval coverage for five commonly-used effect sizes (i.e., the mean difference, standardized mean difference, odds ratio, risk ratio, and risk difference). Sampling error did not cause noticeable bias when the effect size was the mean difference, but the standardized mean difference, odds ratio, risk ratio, and risk difference suffered from this bias to different extents. The bias in the estimated overall odds ratio and risk ratio was noticeable even when each individual study had more than 50 samples under some settings. Also, Hedges' g, which is a bias-corrected estimate of the standardized mean difference within studies, might lead to larger bias than Cohen's d in meta-analysis results. Cautions are needed to perform meta-analyses with small sample sizes. The reported within-study variances may not be simply treated as the true variances, and their sampling error should be fully considered in such meta-analyses.
Identifier: FSU_pmch_30212588 (IID), 10.1371/journal.pone.0204056 (DOI), PMC6136825 (PMCID), 30212588 (RID), 30212588 (EID), PONE-D-18-14403 (PII)
Publication Note: This NIH-funded author manuscript originally appeared in PubMed Central at https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6136825.
Persistent Link to This Record: http://purl.flvc.org/fsu/fd/FSU_pmch_30212588
Host Institution: FSU
Is Part Of: PloS one.
1932-6203
Issue: iss. 9, vol. 13

Choose the citation style.
Lin, L. (2018). Bias caused by sampling error in meta-analysis with small sample sizes. Plos One. Retrieved from http://purl.flvc.org/fsu/fd/FSU_pmch_30212588