SWE-bench Senior

The talk presents three perspectives on data as a central bottleneck in building capable AI systems. The host argues that production performance depends on inspecting real-world failures and investing in expert data and environments, rather than focusing only on model architecture. Vincent Chen describes how Snorkel scales expert supervision, from data programming to validation agents and benchmarks that assess coding quality. Volo presents Inception Labs’ diffusion language models and Tau Forge for creating realistic training and evaluation environments, while Shane explains how multilingual data transfer can guide language mixtures, model sizing, and pretraining choices.