Problems → Prototypes · AILE

← Back to this problem brief

A Practice Lab for Teacher AI Adoption

AI adoption in schools often depends on a few enthusiastic users while other educators receive tool demos without enough time to build judgment about when AI is useful, risky, or instructionally counterproductive.

Try it

This exercise runs locally using simple rules. Your entries stay on this page and clear when you reload. No AI service is called.

Critical review of this working prototype

Strongest assumption: Choosing and explaining before authored consequences improves instructional judgment on unfamiliar cases.

Likely failure: Participants learn that rubric-grounded AI is always preferred, or mistake fixed prose for a scored expert assessment.

Test that could change the design: Randomly compare this lab with paper cases; use a new classroom scenario with different policy and have blinded educators assess justification and safeguards.

Non-AI comparison: Facilitated paper-case comparison and peer review of lesson plans.

Evidence to collect: Independent transfer decisions, implementation safeguards, learner revision quality and confidence calibration; clicks and completion are not learning.

Human control and access: No real student data; fictional policy is not local authorization. Free text is unscored and local. Exports can contain personal reflections. Keyboard-native controls and paper alternatives preserve access.

Changes made during review

  • Added a useful teacher-only alternative in both cases and a failure inside the rubric-grounded path.
  • Required reasoning before consequences, added revision/export, and invalidate feedback on every initial-input change.
  • Next smallest experiment: educator review of the two case consequence sets before a transfer pilot.

This is a design and implementation review, not an empirical validation of learning outcomes.

Optional AI critique

Take the brief into your own AI environment

Nothing is sent until you choose.

Copy a self-contained review prompt, then open the AI workspace you already use. The prompt asks for a falsification test, a non-AI alternative, evidence that distinguishes activity from learning, and human-system risks.

Preview the prompt
Act as a critical learning-engineering reviewer. Review the prototype brief below as a thin-slice experiment, not as a finished product.

Return:
1. The strongest design assumption.
2. The most important plausible failure mode.
3. The highest-value falsification test for the next cycle.
4. One credible non-AI alternative that could address the same capability gap.
5. The next smallest prototype worth building.
6. What should be measured to distinguish engagement from learning, transfer, and real performance.
7. Human-agency, equity, accessibility, privacy, or governance concerns that should change the design.

Be concrete. Separate evidence-backed claims from hypotheses. Do not reward novelty for its own sake, and do not assume more AI is better.

COLLECTION: AILE
TITLE: A Practice Lab for Teacher AI Adoption

CAPABILITY GAP:
AI adoption in schools often depends on a few enthusiastic users while other educators receive tool demos without enough time to build judgment about when AI is useful, risky, or instructionally counterproductive.

FIRST PROTOTYPE:
Build a scenario-based professional learning lab where teachers practice making AI-use decisions, try bounded tools on authentic planning tasks, see failure cases, and receive feedback tied to an explicit competency framework and local policy.

REPRESENTATIVE USE CASE:
A teacher chooses whether to use AI to generate feedback on student writing, then compares three configurations: unrestricted generation, rubric-grounded suggestions, and teacher-only planning support.

LEARNING / HUMAN-SYSTEM FRAME:
Teacher learning should involve application, reflection, feedback, and opportunities to revise—not one-time compliance training. The goal is professional judgment and human agency in a teacher–AI–student system.

QUESTIONS ALREADY IDENTIFIED:
1. Which competencies predict responsible classroom use?
2. What kinds of practice change teacher behavior rather than only attitudes?
3. How should local policy and subject-area pedagogy alter the scenarios?

FIRST-CYCLE FRAMING:
Understand: Validate that the real gap is the ability to make context-sensitive instructional decisions about AI use, not simply low engagement, low tool use, or a workflow inconvenience.
Map: Map the system: teacher, students, curriculum, school policy, AI tools, professional learning team, and leadership. Identify where the capability currently succeeds, breaks down, or is masked by other constraints.
Instrument: Predefine evidence: scenario judgment, classroom implementation quality, policy alignment, teacher confidence calibration, and student learning evidence. A key disconfirming signal is: teachers report higher confidence but make no better instructional or risk-management decisions.
Open the underlying design brief and eight-step path

A first prototype

Build a scenario-based professional learning lab where teachers practice making AI-use decisions, try bounded tools on authentic planning tasks, see failure cases, and receive feedback tied to an explicit competency framework and local policy.

Representative use case

A teacher chooses whether to use AI to generate feedback on student writing, then compares three configurations: unrestricted generation, rubric-grounded suggestions, and teacher-only planning support.

Questions worth carrying forward

  • Which competencies predict responsible classroom use?
  • What kinds of practice change teacher behavior rather than only attitudes?
  • How should local policy and subject-area pedagogy alter the scenarios?

Evidence anchors

These sources motivate the design; they do not validate this prototype.

LENS iteration cycle

One possible first pass

Refine → Understand
  1. 01
    Understand

    Validate that the real gap is the ability to make context-sensitive instructional decisions about AI use, not simply low engagement, low tool use, or a workflow inconvenience.

  2. 02
    Map

    Map the system: teacher, students, curriculum, school policy, AI tools, professional learning team, and leadership. Identify where the capability currently succeeds, breaks down, or is masked by other constraints.

  3. 03
    Design

    Compare an AI intervention with simpler non-AI options. Specify what the human decides, what the AI may suggest, and which tradeoffs are acceptable.

  4. 04
    Build

    Create the smallest usable prototype around one representative task, with expert-curated content, visible uncertainty, and an easy human override.

  5. 05
    Instrument

    Predefine evidence: scenario judgment, classroom implementation quality, policy alignment, teacher confidence calibration, and student learning evidence. A key disconfirming signal is: teachers report higher confidence but make no better instructional or risk-management decisions.

  6. 06
    Deploy

    Pilot with a small, representative group in a near-real setting; preserve a baseline or comparison condition and document implementation conditions.

  7. 07
    Evaluate

    Look for capability growth and transfer, not just satisfaction or activity. Inspect subgroup patterns, human workload, errors, and unintended adaptations.

  8. 08
    Refine

    Let the evidence change the problem model. Default back to UNDERSTAND if the assumed gap was wrong; otherwise revisit the earliest step invalidated by the evidence.