MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines

Meta introduces MTIA 300, its first training-optimized chip built specifically for recommendation and ranking models, featuring built-in NIC chiplets and dedicated communication-offloading engines. Unlike GPUs, where collective communication operations compete with compute for shared resources, MTIA 300 integrates 12 custom 800 Gbps RDMA NICs directly on-chip and 16 dedicated message engines that handle AllReduce, AllToAll, and AllGather collectives independently, achieving less than 0.5% compute degradation versus over 20% on GPUs. Co-designed with the HCCL communication library, which compiles collectives into autonomous work-queue subgraphs executed without host involvement, the system delivers up to 940 GB/s bandwidth per rack and 3.9x faster communication than equivalent GPU clusters on a 150-billion-parameter production model across 40 accelerators.

Nguồn: https://engineering.fb.com/2026/08/24/networking-traffic/mtia-300-meta-training-chip-built-in-nics. 8 Sync News chỉ tóm tắt và dẫn link; bản quyền nội dung thuộc tác giả và nguồn gốc.