ByteByteGo0 Hot0 bình luận14 phút đọc2 giờ trước

How OpenAI Delivers Low-Latency Voice AI for 900M Users

OpenAI serves voice AI to 900 million weekly users by splitting WebRTC infrastructure into two components: a stateless relay for packet routing at the geographic edge and a stateful transceiver that owns ICE, DTLS, and SRTP state. The key routing trick encodes destination metadata into the ICE ufrag field, allowing the relay to forward the first packet to the correct transceiver without a database lookup. The relay is implemented in Go using SO_REUSEPORT, thread pinning via runtime.LockOSThread, and pre-allocated buffers — avoiding kernel bypass entirely. Global Relay distributes ingress points geographically, with Cloudflare handling proximity-based signaling steering. The post also covers why SFU and TURN were evaluated and rejected for this predominantly 1:1 workload, and discusses tradeoffs including limited multiparty support and a custom infrastructure maintenance burden.

Đọc bài gốc

#golang #distributed-systems #webrtc

Nguồn: https://blog.bytebytego.com/p/how-openai-delivers-low-latency-voice. 8sync News chỉ tóm tắt và dẫn link; bản quyền nội dung thuộc tác giả và nguồn gốc.