Individual participant data meta-analysis: pooled effect of EEF funded educational trials on low baseline attaining group

Uwimpuhwe, Germaine; Singh, Akansha; Akhter, Nasima; Ashraf, Bilal; Coolen-Maturi, Tahani; Robinson, Thomas; Higgins, Steve; Einbeck, Jochen

Abstract

The Education Endowment Foundation (EEF), a charity aiming to break the link between socioeconomic disadvantage and pupil attainment, has commissioned over 200 randomised controlled trials. The collection of data from these trials, the `EEF Data Archive’, forms a rich repository. It is vital to understand the overall impact of EEF-funded interventions on disadvantaged pupils’ attainment, as well as the `attainment gap' to their peers. The EEF Data Archive allows gaining such understanding. This study utilized individual-level pupils’ data from 100 trials available in this archive, with disadvantaged pupils being indicated by students belonging to the lowest tertile of the baseline scores for each trial. A Bayesian multilevel IPD meta-analysis was applied to the standardised outcome measures (mathematics and literacy) to estimate the pooled effect size and the attainment gap. The preliminary analysis revealed that EEF-funded interventions improved low-attaining pupils’ attainment for literacy (effect size: 0.033, 95\% CI: 0.011, 0.055) and mathematics outcomes (effect size: 0.019, 95\% CI: -0.001, 0.038). Overall, the results align with the EEF mission of increasing the attainment of disadvantaged pupils and closing the attainment gap.

Citation

Uwimpuhwe, G., Singh, A., Akhter, N., Ashraf, B., Coolen-Maturi, T., Robinson, T., Higgins, S., & Einbeck, J. (2023, July). Individual participant data meta-analysis: pooled effect of EEF funded educational trials on low baseline attaining group. Presented at International Workshop on Statistical Modelling, Dortmund

• Presentation Conference Type: Conference Paper (published)
• Conference Name: International Workshop on Statistical Modelling
• Start Date: Jul 16, 2023
• End Date: Jul 21, 2023
• Acceptance Date: Mar 27, 2023
• Online Publication Date: Jul 16, 2023
• Publication Date: Jul 16, 2023
• Deposit Date: Sep 19, 2024
• Publicly Available Date: Sep 19, 2024
• Peer Reviewed: Peer Reviewed
• Pages: 640-643
• Series Title: Proceedings of the International Workshop on Statistical Modelling
• Book Title: 37th International Workshop on Statistical Modelling - Proceedings book
• ISBN: 9783947323425
• Keywords: IPD meta analysis; multilevel models; effect size; educational interventions
• Public URL: https://durham-repository.worktribe.com/output/2763809
• Publisher URL: https://iwsm2023.statistik.tu-dortmund.de/
• Other Repo URL: www.statmod.org