Skip to content
Maestro.
MaestroMaestro Overview — contents

The Build

Lessons, Checks & Milestones

The interactive system as it is built: the activities inside a Lead Designer lesson, the lesson's check that writes evidence, and the milestone assessment experience that produces the grade. The whole adaptive engine runs on one fuel — trustworthy evidence of what each learner actually knows — and everything here exists to keep that fuel clean.

The 30-second version

There are three kinds of interaction with different rules: Try it practice inside each lesson part, the lesson's check at the end of every lesson, and the milestone assessment — entered through its Milestone Guide, built in a chosen world from a fixed set of 13 blocks, defended aloud, and reported against weighted criteria. Every shape is a typed schema the Lead Designer fills and code validates; nothing is bespoke per lesson.

Three kinds of interaction

It is critical not to confuse these — they have different purposes, different rules and different security needs.

KindWhereWhat it is & its rules
Try itInside each part of a lessonShort practice with instant feedback. It helps the learner learn; it is retryable, asks for no typing, and is not how the system decides mastery.
The lesson's checkAt the end of every lessonResponse, reasoning in the learner's own words, and confidence, with "I'm not sure" always available. It produces one of five results — Solid · Nearly there · Not yet · Not sure · A mix-up — and is never graded.
Milestone assessmentAt each milestone on the course roadSubstantial work in a chosen context, then a spoken defense, marked against the course's weighted rubric. The design law: lesson results shape the journey; only milestones produce the grade.

Try it activities

Every lesson follows one Lesson Page Standard: an opening case with one choice, then parts — each with Watch (narrated video) or Read instead, and a Try it — with Pause moments, the check, a close and a carry-forward. A Storyline ties the lesson together, and the page is designed phone-first. The Lead Designer chooses each Try it from six mechanics:

Try itWhat the learner does
Sequence and orderPuts steps in order for a fresh situation that shares no wording with the lesson's case.
Classify and categoriseSorts items into the lesson's categories.
Match pairsMatches each item to its partner.
Quick pickPicks the best option from a short set.
Find the errorSpots what is wrong in a short piece of work.
Compare and decide (practice)Judges two attempts side by side — a warm-up for the check's own format.

Each reply's feedback names the card line it comes from, and each tempting wrong move carries a "why not there" written by the designer. A Try it never asks the learner to type and never asks for confidence: that belongs to the check.

The check types

The lesson's check comes in three shapes, each a typed schema:

CheckShape
Compare and decideTwo attempts at the same task; the learner chooses one of four equal verdicts — A is sound, B is sound, both, neither — and justifies it.
Select and justifyChoose the best option and give reasons.
Misconception confrontationPredict the outcome of a case from three or four options, one of which embodies a named mix-up; then explain.

Every check tests specific lines of the lesson's cards, carries a hidden rubric for judging reasoning, and has one feedback block per result plus one per bound misconception. Each check has a variant pool — same idea and rubric, different story — reviewed and approved in Studio; fresh checks and Revision always draw a variant the learner hasn't seen. More in Mastery & the Lesson's Check.

How the evidence stays honest

Any on-screen task whose answer is visible can be outsourced in seconds. That matters twice: it would corrupt marks, and — the deeper problem — a faked check writes a false "Solid" into the learner model and routes the learner past the support they needed. Maestro doesn't fight this with lockdown or detection. It layers the design so real understanding is the cheapest thing to have:

LayerBuilt in StudioRun in Journey
Honesty economicsFeedback written per result, including Not sureNo grade on checks; no correctness in-flow; "I'm not sure" defers the belief write
Your own thinkingRequired reasoning; hidden rubric; declared tempting errorsReasoning judged; "Look again" quotes the learner's own earlier answer
Per-learner variantsApproved variant pools; milestone worlds with per-learner detailsUnseen variants for every re-check
Locked kept work—First answer kept; milestone work locked but readable at submission
Spoken defenseDefense criterion in the rubric and weightsLive voice questions on the learner's own locked work, every milestone
Belief over time—Mastery settles only after an idea survives a later return
Signals support, never accuse—Process signals lower evidence weight against the learner's own baseline; never shown as flags

The integrity reasoning behind each layer is in Academic Integrity.

The Milestone Guide

Every milestone is entered through its Milestone Guide — never directly. The guide is readable at any time, even while the milestone is still ahead. It sets out the outcomes covered, the facts (weight, pass mark, no time limit), "How it goes" in five steps, what the learner will make, the "What counts" table of criteria with their % weights, what AI may and may not be used for, and what the spoken defense asks. Its main button follows the learner's progress:

MomentMain button
Milestone still ahead"Opens after Topic N" (greyed, with the reason)
Required Revision items untried"Start opens after Revision · N left", with a link to Revision
ReadyStart assessment
Work under wayContinue your assessment — back to the task they were on
Submitted, defense not finishedContinue your defense — resumes at the same question

Once results are out, the milestone's doors open the finished assessment page instead; the guide stays readable from its own button.

Choose your world

Starting an assessment, the learner chooses a world — a context for the brief, from a small set approved in Studio with an equivalence check across worlds. The world gives them their brief (role, audience, situation, limits) and their files, and some tasks carry per-learner material. The rubric and standard are identical across worlds; only the context differs.

The assessment blocks

Every milestone uses one page frame; only the tasks and their blocks differ. Each task has a title, a one-sentence purpose, the criteria it counts toward ("Counts toward: … %"), an estimate in minutes, and an AI posture shown as a neutral label. Tasks are built from a fixed registry of 13 blocks:

BlockThe learner…BlockThe learner…
Writewrites prose to a word rangePrompt Benchruns prompts on the course tools; runs are saved
Fill incompletes labelled fields, a grid or a canvasCalculatebuilds a small worked calculation
Choose and justifypicks, then gives reasonsUploadadds a file, within type and size limits
Comparesets things side by side against criteriaSourcesrecords each source and where it is used
Gridfills rows and columnsField notesrecords anonymised conversations, with consent
Mark uphighlights, tags and fixes parts of a textArrange in ordersequences items and explains each
Planlays out steps over time

An assessment that needs something outside the registry is flagged for the subject expert rather than forced into the wrong block.

Building the work

  • Autosave with version history. Every block saves as the learner works, and earlier versions are kept — also serving as process evidence.
  • File uploads with accepted types, size limits and a per-block count.
  • A daily work log and a step tracker beside the tasks.
  • No course navigation and no Atlas inside the assessment; the only way out is the page's own back link.

Before submitting

Submission is also the start of the defense, so the page prepares the learner first: a microphone and speaker test, a reminder to find a quiet place, and a plain note that the work becomes locked but readable. The button says exactly what happens: "I am ready: submit and start my defense".

The spoken defense

The defense is a live voice conversation. The page splits: the learner's locked work on the left, the questions on the right. The learner can cut in at any time and the examiner stops to listen. If the learner leaves, their place is kept; "Continue your defense" picks up at the same question.

For engineers — how the voice works

The browser talks to the realtime model over WebRTC through the AI gateway, using a one-call client secret minted by Maestro's server, which drives the session over a sideband. Code decides every question; the model only speaks the exact question text and transcribes the answer. When the learner speaks over the examiner, the call itself stops the voice and the session simply starts listening. The transcript and the current question are stored on the defense session; no audio is kept. Models are chosen in Admin Center. There is no text fallback: if voice can't run, that is a fault to fix.

Report & results

The weighted report marks each criterion on four levels and combines them with the % weights from the course's Rubric and Weighting review — including the defense criterion, marked from the transcript. A finished assessment opens on its own page with two tabs: Your results (the mark, what each criterion found, feedback per part, the defense transcript, and the pieces to strengthen when below the pass mark) and Your submitted work, locked and read-only. The course page's Your results tab shows that course's assessments; My results lists them across all the learner's courses. Each approved milestone also has its own gradebook column, with its weight, in the institution's LMS. Released course versions are frozen, and each learner stays on the version they took.

The binding contracts

ContractWhat it binds
Lesson publishingA lesson publishes live only with its required pieces: the check and its approved variants, the mix-up message, the second way in, the firm-up prompt, the worked example and the look-again probe. Publishing refuses an incomplete lesson rather than letting a learner page fail.
The milestone packEvery rubric criterion is served by a task; every task serves a criterion or named process evidence; every block's configuration is complete; AI postures match the course's AI rule; no block outside the registry. The pack is frozen per build, so a later edit never reaches work already under way.
Typed answersEvery Try it, check and block has a schema for its configuration and its answers, and the server validates every answer.

Design laws — do not violate these

  • Lesson checks are never graded. Only milestones produce the grade, and a grade never re-decides a lesson's result.
  • No correctness feedback in-flow during a check. The first answer is kept; the result card comes after submission.
  • A check is never a simple right/wrong quiz. Response + reasoning + confidence, always; "I'm not sure" always available and penalty-free.
  • Learners see only learner words. Solid · Nearly there · Not yet · Not sure · A mix-up — never band names, engine words or scores on lesson results.
  • Every milestone goes through its guide and ends in a spoken defense.
  • Nothing reaches a learner unreviewed. Variants, worlds and remediation pieces are approved in Studio first.
  • Behavioural signals support, never accuse. They weight evidence and prompt support; never surfaced as cheating flags or used as standalone proof.
  • Accessibility is first-class. Keyboard operable, screen-reader supported, working at phone width, with a text alternative ("Read instead") wherever content is a video.
How this relates to the rest of the docs

The check and the learner model live in Mastery & the Lesson's Check; what each result offers next in Adaptivity & Routing; the integrity philosophy in Academic Integrity; the signal inventory in Learning Signals; and the package-level view in the Published Course Package.