Intel Updates LLM-Scaler-vLLM Build For vLLM 0.26 & Other Improvements

Intel released a new beta of LLM-Scaler-vLLM (0.26.0-b1), a Docker-based deployment for running vLLM on Intel Arc Pro GPUs. It rebases against upstream vLLM 0.26, which added DeepSeek-V4 kernel support, improved KV offloading, and JIT warm-up infrastructure. The update also improves time-to-first-token for Qwen models, boosts FP8 KV cache performance, and fixes various bugs. Downloads are available on GitHub.

Nguồn: https://www.phoronix.com/news/Intel-LLM-Scaler-vLLM-0.26.0-b1. 8 Sync News chỉ tóm tắt và dẫn link; bản quyền nội dung thuộc tác giả và nguồn gốc.