Engineering Founders

The Product Paradigm Shift: How LiveKit Navigated High Stakes Scaling Challenges to Build the Future of Voice-First AI Interfaces w/ Russ d’Sa

Episode Summary

Russ d’Sa (CEO & Co-founder @ LiveKit) joins the show to deconstruct the "Product Paradigm Shift" toward voice-driven interfaces and agent-centric UX . We dive into LiveKit’s high-stakes scaling lessons: from powering OpenAI and Character AI’s voice mode, how they navigated real time bottlenecks to hit the next level of scale, the architectural necessity of a multi-cloud strategy, and the foundations of a co-founder relationships that can effectively blend engineering & business strategy.

Episode Notes

Russ d’Sa (CEO & Co-founder @ LiveKit) joins the show to deconstruct the "Product Paradigm Shift" toward voice-driven interfaces and agent-centric UX . We dive into LiveKit’s high-stakes scaling lessons: from powering OpenAI and Character AI’s voice mode, how they navigated real time bottlenecks to hit the next level of scale, the architectural necessity of a multi-cloud strategy, and the foundations of a co-founder relationships that can effectively blend engineering & business strategy.

ABOUT RUSS D’SA

Russ is a startup vet who founded his first company in the 2007 YC batch and was the 2nd frontend engineer hired at Twitter, Russ d'Sa now leads voice AI unicorn LiveKit. They're the backbone of ChatGPT Voice Mode, Salesforce Agentforce, Grok, and roughly 30% of US 911 calls.

ABOUT LIVEKIT

LiveKit is an open source framework and cloud platform for building voice, video, and physical AI agents. It provides the tools you need to build agents that interact with users in realtime over audio, video, and data streams. Agents run on the LiveKit server, which supplies the low-latency infrastructure (including transport, routing, synchronization, and session management) built on a production-grade WebRTC stack. This architecture enables reliable and performant agent workloads.

SHOW NOTES:

• The product paradigm shift toward voice-driven apps and natural human-computer interfaces (2:30)
• Voice-apps in practice: How these trends impact the strategy of product building today (5:18)
• Early adopters: Why legacy industries like healthcare use voice AI (7:41)
• Reevaluating and building product experiences optimized for AI agents (12:38)
• How AI trends will impact roadmaps and Go To Market ****(18:02)
• The origin of LiveKit: Building real-time infra for the pandemic (20:53)
• The OpenAI moment: Powering the fastest-growing consumer app (23:32)
• Scaling with OpenAI: Navigating the challenges of balancing time-to-market with system design (25:23)
• The Character AI outage: Solving cross-continental state sync and hitting the next level of scale (28:46)
• The problem: When telemetry breaks first: Managing analytics and logging for millions of concurrent AI sessions (31:50)
• Architecting for resilience: Multi-cloud from day one and why treating infra as a utility matters (33:08)
• Co-founder dynamics: Blending engineering strategy with business outcomes (37:01)
• Rapid Fire Questions (40:37)

This episode wouldn’t have been possible without the help of our incredible production team:

Patrick Gallagher - Producer & Co-Host

Jerry Li - Co-Host

Noah Olberding - Associate Producer, Audio & Video Editor https://www.linkedin.com/in/noah-olberding/

Dan Overheim - Audio Engineer, Dan’s also an avid 3D printer - https://www.bnd3d.com/

Ellie Coggins Angus - Copywriter, Check out her other work at https://elliecoggins.com/about/