Securing the Future of High-Stakes Testing:The Duolingo English Test Human-in-the-Loop AI Ecosystem
The Duolingo English Test (DET) is an online, remotely administered high-stakes assessment of English language proficiency. A test taker can take it on their own computer, anywhere and any time, with results returned within 48 hours. Because every session is recorded and reviewed rigorously after submission, our security system has even more signals to work with than a live proctor does.
In this talk, we present our multi-layered security system that leverages human-in-the-loop AI to protect the integrity of the Duolingo English Test. It spans multiple signal sources and modalities: the responses a test taker submits, where we detect AI-generated responses; the way those responses were produced, where typing behavior separates transcription from organic writing; the patterns that connect one session to another, which reveal impersonation and collusion; and what the cameras show, where we direct proctors to the moments worth further examining. Each layer brings additional robustness to the overall security posture.
The presentation goes through a representative set of these security layers in practitioner detail: the threat that motivated the work, how the detector was built, and how it is evaluated and applied in practice, supported by our peer-reviewed research at EMNLP, AAAI, HCOMP, NCME and AIME-Con. We will also present the human oversight on top of the AI system, and how we ensure that final decisions are accurately made with human judgment in combination with AI signals.
We hope to provide insights that can inform the design of human-in-the-loop AI systems that secure the integrity of high-stakes assessments.
About the e-Assessment Association
The e-Assessment Association (eAA) is the global, independent community for professionals involved in digital assessment. As a not-for-profit organisation, we connect practitioners, technology providers, educators, awarding organisations and researchers around the world to share expertise, set standards and champion the trusted use of technology to transform assessment practice and policy. Our community offers valuable insights, events, resources and opportunities that support professional growth and innovation across all sectors of education and assessment.
Special Interest Groups (SIGs) and Networks are at the heart of our collaborative activity. SIGs bring together members with shared interests in specific areas of digital assessment to exchange ideas, share best practice and advance their collective expertise. Through focused discussions, webinars, working groups and content contributions, SIGs help shape the agenda in areas such as AI in assessment, accessibility, online proctoring, workforce mobility and more.
Our Networks provide facilitated communities for specific audiences. For example, the Awarding Organisation (AO) Network supports assessment organisations to collaborate, share experience and develop practice in technology-enabled assessment delivery.
We encourage you to explore all that the eAA has to offer. Visit www.e-assessment.com to find upcoming events, join a Special Interest Group, access resources, and become part of our vibrant global community. Members can log in to view exclusive content, engage with peers and help shape the future of digital assessment.

