WhoBuilt

Your Biggest User Isn't Human: Designing DevTools for AI Agents

Sep 21, 2026· 19 min· 858 views·Watch on YouTube

Speaker

David Mokos of Expo explains how to design developer tools for coding agents at Agent Conf 2026, in a talk hosted by Callstack.

Make tools work for developers’ agents

Mokos describes Expo’s shift from building its own coding harness to supporting the agents developers already use, such as Codex, Claude Code, and OpenCode. He says about 50% of commands across Expo’s and EAS’s CLIs are already run by coding agents.

Close the mobile development loop

Agents need to write code, build apps, and test them, but iOS development adds requirements such as macOS and Xcode. Expo’s cloud simulator service, then in beta, lets agents test apps remotely; Expo also provides tools for building apps and delivering them to TestFlight and the App Store.

Collect feedback from agents

Expo can see how agents use its CLIs, documentation, skills, MCP servers, and simulator, but it cannot see where they struggle inside third-party coding harnesses. Mokos says internal agent telemetry helped, though its sample was small. Expo then added feedback instructions to its skills and Markdown documentation, receiving dozens of useful reports per day, including conflicting guidance and an animation snippet that crashed apps.

Turn feedback into fixes and evals

Expo routes submissions through a classifier to filter spam, then uses embeddings and a frontier model to match feedback with existing Linear issues or create new ones. Background agents fetch issues, investigate them using simulators, and open pull requests for human review. Mokos says agents can also propose eval tasks by describing what they tried, what they expected, and what happened.

Build a self-improving loop

Mokos recommends giving agents a way to report problems, gathering conversation history where possible, and turning observed struggles into evals. The aim is to use agent feedback to improve tools and keep the feedback, fixes, and evaluation cycle moving.

Takeaways

  • Add a clear feedback path to the docs and skills agents already read.
  • Track agent interactions internally to find recurring failures, while recognizing a small sample may miss patterns.
  • Filter and group feedback before sending it to issue trackers so teams can focus on actionable reports.
  • Use background agents to investigate issues and open fixes that people can review.
  • Turn real agent failures into eval tasks with a goal, expected result, and observed result.

Mentioned in this talk

Search inside this talk

What was claimed 14

Show all 14 facts

Related talks