25:53Angel Ortmann Lee argues that human-in-the-loop AI can fail when people defer to AI output instead of examining it. In a Duolingo English Test study, proctors accepted half of deliberately false cheating signals; clearer review guidance increased rejection of those signals. She shows how interface design can encourage independent judgment, produce richer feedback, and improve AI systems over time. Her design principles include matching review friction to the stakes, surfacing assumptions, structuring interactions, and treating each interaction as a potential label.
