Problems → Prototypes · AILE
Mastery Pathways for Mixed-Readiness Classrooms
A single classroom can contain wide variation in prior knowledge and pace, while teachers have limited time to diagnose every learner and create individualized practice. AI personalization can help, but only if it is tied to clear mastery evidence rather than opaque engagement scores.
This exercise runs locally using simple rules. Your entries stay on this page and clear when you reload. No AI service is called.
One target: adding fractions with unlike denominators
Use a drawing of 2/3 = 4/6, an explanation of 1/2 + 1/3, and a new-context task to inform judgments. Start unobserved when evidence is missing. Do not enter learner names.
A fixed fraction-learning pathway using teacher-entered judgments. The rules show their reasoning, keep missing evidence separate from observed difficulty, and allow a reasoned teacher override. This tool does not diagnose learners or certify mastery.
Reviewable draft
Teacher guide (separate from learner export)
Downloads contain your entered text. Review before sharing. Changing any input clears this result; generate again to revise.
Critical review of this working prototype
Strongest assumption: Teacher-entered evidence and visible routing help adapt fraction practice without lowering the common learning target.
Likely failure: Unobserved work is read as low performance, inconsistent judgments cause unnecessary remediation, or a pathway traps a learner in prerequisite practice.
Test that could change the design: Give teachers mixed and missing evidence, including correct transfer with an incomplete diagnostic, and compare decisions with a paper evidence matrix. Reject if the tool causes unnecessary repetition or narrows access to transfer. Next smallest prototype: observe one teacher reviewing three contrasting work samples.
Non-AI comparison: A fraction evidence matrix, manipulatives, and a short teacher conference.
Evidence to collect: Independent conceptual explanation, fresh-context performance, delayed retention, time in prerequisite practice, opportunities for transfer, and reasons for overrides. No telemetry or learner profiles are implemented.
Human control and access: Judgments are supplied by teachers and not automatically assessed. Missing evidence, language, disability, and speed must not become ability labels. Fixed examples can leak answers if reused as assessment. No identifying data is needed, and teachers can override with a reason.
Changes made during review
- Defaulted all evidence to unobserved and required descriptions for observed judgments.
- Preserved rule reasoning and evidence alongside a teacher override; required an override reason.
- Critical review found that uneven evidence could over-route to prerequisite support: added an explicit reconciliation warning and a new-context opportunity each practice cycle.
- Kept the standard stable, required later evidence before durable-mastery conclusions, and separated example solutions into a teacher guide.
This is a design and implementation review, not an empirical validation of learning outcomes.
Take the brief into your own AI environment
Copy a self-contained review prompt, then open the AI workspace you already use. The prompt asks for a falsification test, a non-AI alternative, evidence that distinguishes activity from learning, and human-system risks.
Preview the prompt
Act as a critical learning-engineering reviewer. Review the prototype brief below as a thin-slice experiment, not as a finished product. Return: 1. The strongest design assumption. 2. The most important plausible failure mode. 3. The highest-value falsification test for the next cycle. 4. One credible non-AI alternative that could address the same capability gap. 5. The next smallest prototype worth building. 6. What should be measured to distinguish engagement from learning, transfer, and real performance. 7. Human-agency, equity, accessibility, privacy, or governance concerns that should change the design. Be concrete. Separate evidence-backed claims from hypotheses. Do not reward novelty for its own sake, and do not assume more AI is better. COLLECTION: AILE TITLE: Mastery Pathways for Mixed-Readiness Classrooms CAPABILITY GAP: A single classroom can contain wide variation in prior knowledge and pace, while teachers have limited time to diagnose every learner and create individualized practice. AI personalization can help, but only if it is tied to clear mastery evidence rather than opaque engagement scores. FIRST PROTOTYPE: Build a teacher-facing mastery pathway tool that links each learning objective to diagnostic tasks, prerequisite skills, practice options, and observable mastery evidence. AI can propose next activities, but teachers see and can override the reasoning. REPRESENTATIVE USE CASE: In a mathematics unit, one learner receives prerequisite fraction practice, another receives a transfer problem, and both must demonstrate the same target concept through an explanation and novel problem. LEARNING / HUMAN-SYSTEM FRAME: Personalization should adapt support while holding the capability target and evidence standard stable. Feedback, metacognitive monitoring, and opportunities to transfer learning matter more than merely accelerating task completion. QUESTIONS ALREADY IDENTIFIED: 1. Which evidence is sufficient to advance a learner? 2. How transparent must the recommendation logic be for teachers and families? 3. Does the system narrow or widen opportunity gaps over time? FIRST-CYCLE FRAMING: Understand: Validate that the real gap is the ability to reach and demonstrate mastery from different starting points, not simply low engagement, low tool use, or a workflow inconvenience. Map: Map the system: learners, teacher, curriculum progression, diagnostic tasks, AI recommender, and classroom schedule. Identify where the capability currently succeeds, breaks down, or is masked by other constraints. Instrument: Predefine evidence: mastery, time-to-mastery, transfer, teacher override patterns, opportunity gaps, and learner self-monitoring. A key disconfirming signal is: the system optimizes completion pace without improving durable mastery or equity.
Open the underlying design brief and eight-step path
A first prototype
Build a teacher-facing mastery pathway tool that links each learning objective to diagnostic tasks, prerequisite skills, practice options, and observable mastery evidence. AI can propose next activities, but teachers see and can override the reasoning.
Representative use case
In a mathematics unit, one learner receives prerequisite fraction practice, another receives a transfer problem, and both must demonstrate the same target concept through an explanation and novel problem.
Questions worth carrying forward
- Which evidence is sufficient to advance a learner?
- How transparent must the recommendation logic be for teachers and families?
- Does the system narrow or widen opportunity gaps over time?
Evidence anchors
These sources motivate the design; they do not validate this prototype.
- Hattie, J., & Timperley, H. The Power of Feedback. Review of Educational Research. (2007)
Feedback design and evidence-producing practice.
- Education Endowment Foundation. Metacognition and Self-Regulated Learning, 2nd ed. (2025)
Metacognitive prompts, self-monitoring, and fading support.
- U.S. Department of Education, Office of Educational Technology. Artificial Intelligence and the Future of Teaching and Learning: Insights and Recommendations. (2023)
Human-centered AI in education; governance and instructional use.
- National Academies of Sciences, Engineering, and Medicine. How People Learn II: Learners, Contexts, and Cultures. (2018)
Broad learning-science anchor for learner/context/system modeling and transfer.
- Amershi, S., et al. Guidelines for Human-AI Interaction. CHI 2019. (2019)
Human-AI interaction design and calibrated reliance.
One possible first pass
- 01 Understand
Validate that the real gap is the ability to reach and demonstrate mastery from different starting points, not simply low engagement, low tool use, or a workflow inconvenience.
- 02 Map
Map the system: learners, teacher, curriculum progression, diagnostic tasks, AI recommender, and classroom schedule. Identify where the capability currently succeeds, breaks down, or is masked by other constraints.
- 03 Design
Compare an AI intervention with simpler non-AI options. Specify what the human decides, what the AI may suggest, and which tradeoffs are acceptable.
- 04 Build
Create the smallest usable prototype around one representative task, with expert-curated content, visible uncertainty, and an easy human override.
- 05 Instrument
Predefine evidence: mastery, time-to-mastery, transfer, teacher override patterns, opportunity gaps, and learner self-monitoring. A key disconfirming signal is: the system optimizes completion pace without improving durable mastery or equity.
- 06 Deploy
Pilot with a small, representative group in a near-real setting; preserve a baseline or comparison condition and document implementation conditions.
- 07 Evaluate
Look for capability growth and transfer, not just satisfaction or activity. Inspect subgroup patterns, human workload, errors, and unintended adaptations.
- 08 Refine
Let the evidence change the problem model. Default back to UNDERSTAND if the assumed gap was wrong; otherwise revisit the earliest step invalidated by the evidence.