2025 systematic review in npj Science of Learning
paperCredibility Rating
Gold standard. Rigorous peer review, high editorial standards, and strong institutional reputation.
Rating inherited from publication venue: Nature
Relevant to AI safety researchers interested in real-world AI deployment outcomes and evaluation methodology; provides empirical grounding for debates about AI efficacy and ethical considerations in high-stakes human-facing applications like education.
Metadata
Summary
This 2025 systematic review analyzes 28 studies (4,597 students) on AI-driven intelligent tutoring systems (ITS) in K-12 settings, finding generally positive but modest effects on learning outcomes. Crucially, ITS benefits diminish when compared to non-intelligent tutoring systems, raising questions about the added value of AI complexity. The review calls for longer interventions, diverse samples, and ethical scrutiny of AI deployment in education.
Key Points
- •Meta-analysis of 28 studies with 4,597 K-12 students shows AI-driven ITS produce positive but modest learning improvements overall.
- •Benefits of AI-driven ITS are notably reduced when benchmarked against non-intelligent tutoring systems, questioning AI's marginal value.
- •Current evidence base suffers from short intervention periods and limited demographic diversity, weakening generalizability of findings.
- •Review highlights understudied ethical implications of deploying AI systems in K-12 educational environments.
- •Calls for future research with larger, more diverse samples and longer-term outcome measurement to better assess real-world impact.
Cited by 1 page
| Page | Type | Quality |
|---|---|---|
| Epistemic Sycophancy | Risk | 60.0 |
Cached Content Preview
A systematic review of AI-driven intelligent tutoring systems (ITS) in K-12 education | npj Science of Learning
Skip to main content
Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain
the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in
Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles
and JavaScript.
Advertisement
A systematic review of AI-driven intelligent tutoring systems (ITS) in K-12 education
Download PDF
Download PDF
Subjects
Education
Abstract
The use of artificial intelligence in education (AIEd) has grown exponentially in the last decade, particularly intelligent tutoring systems (ITSs). Despite the increased use of ITSs and their promise to improve learning, their real educational value remains unclear. This systematic review aims to identify the effects of ITSs on K-12 students’ learning and performance and which experimental designs are currently used to evaluate them. The 28 studies analyzed in this systematic review included a total of 4597 students ( N = 4597) and used quasi-experimental designs with varying intervention durations. Overall, our findings suggest that the effects of ITSs on learning and performance in K-12 education are generally positive but are found to be mitigated when compared to non-intelligent tutoring systems. However, additional research with longer interventions and increased sample sizes with greater diversity is warranted. Additionally, the ethical implications of using AI for teaching should be investigated.
Similar content being viewed by others
Development of an artificial intelligence curriculum design for children in Taiwan and its impact on learning outcomes
Article
Open access
04 October 2024
AI tutoring outperforms in-class active learning: an RCT introducing a novel research-based design in an authentic educational setting
Article
Open access
03 June 2025
Exploring the effects of AI literacy in teacher learning: an empirical study
Article
Open access
03 May 2024
Introduction
According to the United Nations Educational, Scientific and
... (truncated, 92 KB total)886d765f8e850c0a | Stable ID: YzFmYzFmMT