What Impacts Should We Expect from
Tutoring at Scale? Exploring Meta-Analytic
Generalizability

Bibliographic Data

Author(s)
Matthew A. Kraft, Beth E. Schueler, Grace Falken
Year of Study
2024
Publication
EdWorkingPapers.com
U.S. public schools are engaged in an unprecedented effort to expand tutoring in the wake of the pandemic. Broad-based support for scaling tutoring emerged, in part, because of the large effects on student achievement found in prior meta-analyses. We conduct an expanded meta-analysis of 282 randomized control trials and explore how estimates change when we better align our sample with a policy-relevant target of inference: large-scale tutoring programs in the U.S. aiming to improve standardized test performance. Pooled effect sizes from studies with stronger target-equivalence remain meaningful, but are only a third to a half as large as those from our full sample. This result is driven by stark declines in pooled effect sizes as tutoring program scale increases. We explore four hypotheses for this pattern and identify a bundled package of design features that our analyses suggest may help to partially inoculate programs from these attenuated effects at scale.

Research Design

Study Design
Meta-Analysis
Methodology
Meta-Analysis
Subject
Math
Reading
Grade Level(s)
Kindergarten,
1st Grade,
2nd Grade,
3rd Grade,
4th Grade,
5th Grade,
6th Grade,
7th Grade,
8th Grade,
9th Grade,
10th Grade,
11th Grade,
12th Grade
Sample size
265 RCT studies
Effect Size
0.42 SD among math and reading (p<0.1); Reading 0.436 SD (p<0.1), Math 0.385 SD (p<0.1)

Program Details

Program Evaluated

Meta-analysis

Duration
Meta-analysis
Student-Tutor Ratio
Either 1:1 tutoring or 1 tutor for a group no more than 8 students