Cognitive Tutor / Carnegie Learning
About this resource · How to use it · Learning engineering connections
What is this resource?
A documented case about Cognitive Tutor / Carnegie Learning. A school-level randomized trial found a high-school Algebra I gain of about 0.21 standard deviations in the second year, with no significant first-year effect. The second-year middle-school estimate was not statistically significant.
How should I use it?
- Read the narrative and five beats, keeping the disclosures and scope limits in view.
- Compare the LE insight with the LENS approach. Identify the system condition that changed what people could do, then check the cited evidence before applying the lesson elsewhere.
How does this connect to LENS and learning engineering?
Connect a model of learning to feedback, a curriculum and an outcome test. The result supports the tested package under the conditions studied. In LEN 1 and LEN 4, map how task evidence becomes a mastery estimate, then design an independent transfer probe. In LEN 9, test an alternative adaptation strategy without changing the rest of the package.
Impact. A school-level randomized trial found a high-school Algebra I gain of about 0.21 standard deviations in the second year, with no significant first-year effect. The second-year middle-school estimate was not statistically significant.
Documented learning engineering. People designed or evaluated a way to develop capability. Inspect what the evidence measures and how far it transfers.
Consider the human, the science and the system
- Human
- Who gained or lost agency, opportunity or well-being? Whose experience is missing from the record?
- Science
- What evidence supports the proposed learning explanation, and what other causes could explain the outcome?
- System
- Which tools, responsibilities, interfaces or conditions enabled the result or prevented recovery?
Cognitive Tutor makes a learning hypothesis testable. Its software offers feedback and practice based on a model of algebra skills, while teachers implement the curriculum. In a large randomized evaluation, high schools assigned to the package performed better in year two. The study did not isolate the contribution of the software or show that the same approach works for every subject.
In brief
Carnegie Learning’s Cognitive Tutor applies cognitive models and Bayesian knowledge tracing to guide algebra practice. In the RAND evaluation, 54 high schools and 68 middle schools were assigned to the blended curriculum package or to continue their existing algebra curriculum. The high-school effect was positive in year two, with no significant first-year effect and no significant second-year middle-school effect. The trial tested the curriculum, software and its implementation as a package. It did not isolate knowledge tracing, establish long-term retention, or explain why the second-year high-school result differed.
The case in five beats
- Cognitive modeling gave the developers a way to specify component algebra skills.
- Step-level observations inform a mastery estimate and guide practice.
- Teachers and students use the software as part of a blended curriculum.
- Schools were randomized to the package or existing curriculum.
- The high-school benefit appeared in year two; the mechanism behind the timing remains open.
LE insight
Connect a model of learning to feedback, a curriculum and an outcome test. The result supports the tested package under the conditions studied.
LENS approach
In LEN 1 and LEN 4, map how task evidence becomes a mastery estimate, then design an independent transfer probe. In LEN 9, test an alternative adaptation strategy without changing the rest of the package.
- 1 Systems Analysis
- 2 Iterative Development
- 3 Human-System Collaboration
- 4 Test & Evaluation
- 5 Sociotechnical Constraints
Problem type · PT5
- Problem type
- D2/PT5
- Induced
- 2.3
- LEO
- 2
What this case does not show
The trial did not isolate the tutoring algorithm, establish durable transfer, or validate the approach outside the tested Algebra I settings.