Options
Accuracy and precision of fixed and random effects in meta‐analyses of randomized control trials for continuous outcomes
Gnambs, Timo; Schroeders, Ulrich (2024): Accuracy and precision of fixed and random effects in meta‐analyses of randomized control trials for continuous outcomes, in: Bamberg: Otto-Friedrich-Universität, S. 86–106.
Faculty/Chair:
Author:
Publisher Information:
Year of publication:
2024
Pages:
Source/Other editions:
Research synthesis methods, 15 (2024), 1, S. 86-106. - ISSN: 1759-2887, 1759-2879
Year of first publication:
2024
Language:
English
Abstract:
Meta-analyses of treatment effects in randomized control trials are often faced with the problem of missing information required to calculate effect sizes and their sampling variances. Particularly, correlations between pre- and posttest scores are frequently not available. As an ad-hoc solution, researchers impute a constant value for the missing correlation. As an alternative, we propose adopting a multivariate meta-regression approach that models independent group effect sizes and accounts for the dependency structure using robust variance estimation or three-level modeling. A comprehensive simulation study mimicking realistic conditions of meta-analyses in clinical and educational psychology suggested that imputing a fixed correlation 0.8 or adopting a multivariate meta-regression with robust variance estimation work well for estimating the pooled effect but lead to slightly distorted between-study heterogeneity estimates. In contrast, three-level meta-regressions resulted in largely unbiased fixed effects but more inconsistent prediction intervals. Based on these results recommendations for meta-analytic practice and future meta-analytic developments are provided.
Keywords: ; ; ; ;
effect size
meta-analysis
missing value
randomized control trial
robust variance estimation
DDC Classification:
RVK Classification:
Type:
Article
Activation date:
March 22, 2024
Permalink
https://fis.uni-bamberg.de/handle/uniba/94441