Speculative Routing: An Architecture for Voice Agents
Voice agents are easy to demo and hard to scale. We landed on an architecture that keeps an agent natural, fast, and predictable: fire every possible response in parallel, let a fast router pick the winner. Here’s the journey, and why this design works. The problem nobody’s demo solves Every voice agent demo looks the same: clean audio, a cooperative user, a short scripted exchange. Then you ship it, and two things break immediately. ...