Triton Plugin Extensions: Enabling TLX and Custom Compiler Passes Out of the Box – PyTorch

PyTorch-Triton 3.7 introduces a plugin extensions system that lets developers load custom compiler passes, MLIR dialects, and DSL extensions into upstream Triton at runtime via shared libraries and the TRITON_PLUGIN_PATHS environment variable — no forking or recompiling required. Meta's Triton Language Extensions (TLX) are the first major consumer, now distributed as the standalone utlx Python package. TLX provides hardware-aware ops for explicit shared memory management, async loads, and asynchronous matrix multiply-accumulate, enabling persistent GEMM kernels. On NVIDIA H100, Triton+TLX matches or exceeds cuBLAS by up to 3.7%. On AMD MI350, it outperforms rocBLAS by 12–15% across all tested shapes. The plugin path produces identical PTX/AMDGCN codegen to the compiled-in fork, confirming zero overhead from dynamic loading. A real-world validation on a GPU Mode Trimul competition achieved 1.61x speedup over the cuBLAS+torch.compile baseline.

Nguồn: https://pytorch.org/blog/triton-plugin-extensions-enabling-tlx-and-custom-compiler-passes-out-of-the-box. 8sync News chỉ tóm tắt và dẫn link; bản quyền nội dung thuộc tác giả và nguồn gốc.

Đề xuất cho bạn

Typescript119 Hot21 phút7 ngày trướcAITop

Announcing TypeScript 7.0

TypeScript 7.0 ra mắt phiên bản biên dịch gốc bằng Go, cải thiện tốc độ build lên 8–12 lần …

#performance#typescript#golang