Options
Single- and Multilevel Perspectives on Covariate Selection in Randomized Intervention Studies on Student Achievement
Stallasch, Sophie E.; Lüdtke, Oliver; Artelt, Cordula; u. a. (2024): Single- and Multilevel Perspectives on Covariate Selection in Randomized Intervention Studies on Student Achievement, in: Educational psychology review, Dordrecht [u.a.]: Springer Science + Business Media B.V, Jg. 36, Nr. 4, 112, S. 1–45, doi: 10.1007/s10648-024-09898-7.
Faculty/Chair:
Title of the Journal:
Educational psychology review
ISSN:
1573-336X
Publisher Information:
Year of publication:
2024
Volume:
36
Issue:
4, 112
Pages:
Language:
English
Abstract:
Well-chosen covariates boost the design sensitivity of individually and cluster-randomized trials. We provide guidance on covariate selection generating an extensive compilation of single- and multilevel design parameters on student achievement. Embedded in psychometric heuristics, we analyzed (a) covariate types of varying bandwidth-fidelity, namely domain-identical (IP), cross-domain (CP), and fluid intelligence (Gf) pretests, as well as sociodemographic characteristics (SC); (b) covariate combinations quantifying incremental validities of CP, Gf, and/or SC beyond IP; and (c) covariate time lags of 1–7 years, testing validity degradation in IP, CP, and Gf. Estimates from six German samples (1868 ≤ N ≤ 10,543) covering various outcome domains across grades 1–12 were meta-analyzed and included in precision simulations. Results varied widely by grade level, domain, and hierarchical level. In general, IP outperformed CP, which slightly outperformed Gf and SC. Benefits from coupling IP with CP, Gf, and/or SC were small. IP appeared most affected by temporal validity decay. Findings are applied in illustrative scenarios of study planning and enriched by comprehensive Online Supplemental Material (OSM) accessible via the Open Science Framework (OSF; https://osf.io/nhx4w).
Keywords: ; ; ; ; ;
Covariate selection
Design parameters
Individual participant data meta-analysis
Individually and cluster-randomized trials
Power analysis
Student achievement
DDC Classification:
RVK Classification:
Peer Reviewed:
Yes:
International Distribution:
Yes:
Open Access Journal:
Yes:
Type:
Article
Activation date:
October 2, 2024
Versioning
Question on publication
Permalink
https://fis.uni-bamberg.de/handle/uniba/98459