Voice AI

Voice agents are easy to demo and hard to scale. The architecture we ended up with fires every possible response in parallel and lets a fast router pick the winner mid-flight. This post walks through everything we tried before it, and why this design is the one we kept. The problem nobody’s demo solves Every voice agent demo looks the same: clean audio, a cooperative user, a short scripted exchange. Then you ship it, and two things break immediately. ...

Voice agent demos are easy to build. A LiveKit worker, an STT → LLM → TTS pipeline, and you have something that talks. The hard part is making it reliable. We run AI call agents on LiveKit. An call lasts up to an hour. A lost recording is a compliance problem. A lost transcript means the user has to redo the call. A silent agent means a human sitting in an empty room, wondering if anyone is there. ...