Everything we build is grounded in research on how oral assessment reveals understanding — and how it doesn't. We share our work openly, mark clearly what is still a hypothesis, and hold ourselves accountable to the evidence.
Does oral assessment surface understanding the essay alone hides?
Are AI scores within the same range as a panel of experienced teachers?
Do conversation scores differ across language background, disability, or socioeconomic indicators?
Does knowing an oral defense is coming change how students engage with their work before they submit?
Working Papers
A critical review of why oral assessment — long sidelined in mass education because it does not scale — deserves reconsideration as a response to generative AI. We synthesize the evidence on oral versus written assessment, the cognitive science of retrieval and dialogue, and early work on AI-mediated oral assessment, and argue that conversational AI may relax the cost constraint that once confined oral exams to elite settings. We are explicit that this central claim is a hypothesis to be tested — not an established result — and we set out the research agenda that would test it. Not yet peer-reviewed.
The empirical companion to the review above. With partner schools, we are studying how AI-mediated oral assessment compares to experienced teachers' judgment (validity), whether outcomes differ across student groups (equity), and how the format shapes the way students prepare and learn. Data collection is underway; we will report findings — and their limitations — only when the evidence supports them.
How We Work
We document our research methodology — study design, measures, and analysis — and share it with partner schools on request.
AI scores are calibrated against a panel of experienced teachers, with ongoing review of agreement rates.
We actively test for score disparities across language background, disability status, and socioeconomic indicators. If we find them, we investigate them.
Viva scores are advisory signals. Final grade decisions remain with the teacher. We are explicit about this in every interface.
Partner with our research team
We collaborate with universities, school districts, and independent researchers working on assessment, integrity, and AI in education.
Reach out →