Meta-Analytic Structural Equation Modeling With Fallible Measurements

Faculty/Professorship: Leibniz Institute for Educational Trajectories (LIfBi) 
Author(s): Gnambs, Timo  ; Sengewald, Marie-Ann  
Title of the Journal: Zeitschrift für Psychologie
ISSN: 2151-2604, 2190-8370
Publisher Information: Göttingen : Hogrefe
Year of publication: 2023
Volume: 231
Issue: 1
Pages: 39-52
Language(s): English
DOI: 10.1027/2151-2604/a000511
Meta-analytic structural equation modeling (MASEM) combines the strengths of meta-analysis with the flexibility of path models to address multivariate research questions using summary statistics. Because many research questions refer to latent constructs, measurement error can distort effect estimates in MASEMs if the unreliability of study variables is not properly acknowledged. Therefore, a comprehensive Monte Carlo simulation evaluated the impact of measurement error on MASEM results for different mediation models. These analyses showed that point estimates in MASEM were distorted by up to a third of the true effect, while confidence intervals exhibited undercoverage that were less than 10% in some situations. However, the use of adjustments for attenuation facilitated recovering largely undistorted point and interval estimates in MASEMs. These findings emphasize that MASEMs with fallible measurements can often yield highly distorted results. We encourage applied researchers to regularly adopt adjustment methods that account for attenuation in MASEMs.
GND Keywords: Metaanalyse; Strukturgleichungsmodell; Messfehler
Keywords: meta-analysis, structural equation modeling, mediation, reliability
DDC Classification: 150 Psychology  
RVK Classification: CM 3000   
Peer Reviewed: Ja
International Distribution: Ja
Type: Article
Release Date: 21. April 2023