Module 5: AI-Assisted Assessment Engineering - Worked Examples

Agentic Engineering for Teaching Professionals

These examples move from bounded AI assistance toward reusable teaching workflows. Adapt every prompt to the participant's actual subject, institution, learner level, evidence, and authorized tools rather than treating any template as universally correct.

Building a Table of Specifications

For this illustrative ten-item assessment, the instructor approves 40 percent for identifying claims and 60 percent for evaluating evidence. The approved cognitive allocation is two recall, three interpretation, and five application items. Reconcile the blueprint.

Step-by-Step Solution

0 of 3 Steps Completed
1

Generating MCQs from a TOS

Apply this exercise to a specific teaching context and preserve the learner level, governing evidence, and institutional constraints that make the result valid.

Step-by-Step Solution

0 of 3 Steps Completed
1

Repairing Weak Distractors

Apply this exercise to a specific teaching context and preserve the learner level, governing evidence, and institutional constraints that make the result valid.

Step-by-Step Solution

0 of 3 Steps Completed
1

Detecting an Ambiguous Question

Apply this exercise to a specific teaching context and preserve the learner level, governing evidence, and institutional constraints that make the result valid.

Step-by-Step Solution

0 of 3 Steps Completed
1

Creating an Essay Assessment and Rubric

Apply this exercise to a specific teaching context and preserve the learner level, governing evidence, and institutional constraints that make the result valid.

Step-by-Step Solution

0 of 3 Steps Completed
1

Creating a Mathematical Problem-Solving Assessment

Apply this exercise to a specific teaching context and preserve the learner level, governing evidence, and institutional constraints that make the result valid.

Step-by-Step Solution

0 of 3 Steps Completed
1

Designing an Authentic Performance Task

Apply this exercise to a specific teaching context and preserve the learner level, governing evidence, and institutional constraints that make the result valid.

Step-by-Step Solution

0 of 3 Steps Completed
1

Generating and Validating a Parallel Form

Apply this exercise to a specific teaching context and preserve the learner level, governing evidence, and institutional constraints that make the result valid.

Step-by-Step Solution

0 of 3 Steps Completed
1

Hands-On Lab — Build a TOS and Validated Mini-Assessment

Activity goal: Create a small assessment from outcomes, blueprint it before writing items, then validate the resulting questions and rubric.

Required evidence and deliverables:

  • A TOS covering at least three outcomes/content areas.
  • Six assessment items across at least two formats.
  • Verified keys or expected-solution outlines.
  • One analytic rubric for a constructed/performance task.
  • An item-quality audit documenting ambiguity, distractors, and alignment.

Assessment rubric — 25 points

CriterionPointsRequired evidence
Blueprint quality5Weights, cognitive demand, formats, and totals are coherent and justified.
Item alignment5Each item maps to the intended evidence and cognitive demand.
Correctness5Keys, expected solutions, units, and assumptions are independently verified.
Rubric quality5Criteria describe observable evidence and defensible performance differences.
Validation5Ambiguity, fairness, distractors, workload, and coverage are explicitly reviewed.

Step-by-Step Solution

0 of 5 Steps Completed
1