Show simple item record

AuthorLin, Lifeng
AuthorXu, Chang
AuthorChu, Haitao
Available date2021-09-19T11:15:35Z
Publication Date2021-01-01
Publication NameJournal of General Internal Medicine
Identifierhttp://dx.doi.org/10.1007/s11606-021-07098-5
CitationLin, L., Xu, C. & Chu, H. Empirical Comparisons of 12 Meta-analysis Methods for Synthesizing Proportions of Binary Outcomes. J GEN INTERN MED (2021). https://doi.org/10.1007/s11606-021-07098-5
ISSN0884-8734
URIhttp://hdl.handle.net/10576/23252
AbstractBackground: Meta-analysis is increasingly used to synthesize proportions (e.g., disease prevalence). It can be implemented with widely used two-step methods or one-step methods, such as generalized linear mixed models (GLMMs). Existing simulation studies have shown that GLMMs outperform the two-step methods in some settings. It is, however, unclear whether these simulation settings are common in the real world. We aim to compare the real-world performance of various meta-analysis methods for synthesizing proportions. Methods: We extracted datasets of proportions from the Cochrane Library and applied 12 two-step and one-step methods to each dataset. We used Spearman’s ρ and the Bland–Altman plot to assess their results’ correlation and agreement. The GLMM with the logit link was chosen as the reference method. We calculated the absolute difference and fold change (ratio of estimates) of the overall proportion estimates produced by each method vs. the reference method. Results: We obtained a total of 43,644 datasets. The various methods generally had high correlations (ρ > 0.9) and agreements. GLMMs had computational issues more frequently than the two-step methods. However, the two-step methods generally produced large absolute differences from the GLMM with the logit link for small total sample sizes (< 50) and crude event rates within 10–20% and 90–95%, and large fold changes for small total event counts (< 10) and low crude event rates (< 20%). Conclusions: Although different methods produced similar overall proportion estimates in most datasets, one-step methods should be considered in the presence of small total event counts or sample sizes and very low or high event rates.
SponsorThis research was supported in part by the US National Institutes of Health/National Library of Medicine grant R01 LM012982 and National Institutes of Health/National Center for Advancing Translational Sciences grant UL1 TR001427. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The financial support had no involvement in the conceptualization of the report and the decision to submit the report for publication.
Languageen
PublisherSpringer
SubjectCochrane review
data transformation
generalized linear mixed model
meta-analysis
proportion
TitleEmpirical Comparisons of 12 Meta-analysis Methods for Synthesizing Proportions of Binary Outcomes
TypeArticle
ESSN1525-1497
dc.accessType Full Text


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record