TrueSkill

The speakers explain how OpenAI built a Dota 2 bot through large-scale reinforcement learning, careful engineering, and repeated experiments. They describe choosing Dota for its Linux support and bot API, building a Python and Gym-compatible environment, and improving performance through self-play, replay data, and expert feedback. The project’s progress depended heavily on infrastructure, reliable code, useful metrics, and fast iteration rather than exotic models alone. The bot’s encounters with professional players revealed both unexpected strategies and exploitable gaps, showing how games can serve as scalable test beds for AI research.