WhoBuilt

SOMA

Also known as sharded optimization mixture of assemblies

Key facts

Capabilities
clusters data and trains a small expert model per cluster, then routes among the models at test time

Timeline 1

Dated events, newest first. Open the sources under any item.

How we verify
20261 event
  1. as of Oct 2026Capability
    Clusters data and trains a small expert model per cluster, then routes among the models at test time
    “I call SOMA: sharded optimization mixture of assemblies” 10:11
    Unverified1 source· Talk

Talks 1

1:20:35
What If We Stopped Using GPUs?

The talk surveys alternatives to GPU based computing, arguing that hardware and learning algorithms need to be designed together. The host presents zero order optimization and sharded model assemblies as ways to train without backpropagation, then introduces optical computing and neuromorphic hardware as possible energy efficient substrates. The optical computing presentation explains how light can perform parallel linear operations and describes a fixed optical system for diffusion image generation, along with its limits in memory, nonlinear operations, and data conversion. The neuromorphic presentations cover brain inspired circuit design and a system that trains cultured brain cells to play Doom through learned stimulation, decoding, and feedback.

3 wk ago· 1 h 21 minDiscussed 10:11