Maximize AI Factory Energy Efficiency Through Full-Stack Inference and Training Optimizations

OpenAI and Broadcom build a chip to rival Nvidia’s Blackwell

OpenAI và Broadcom hợp tác phát triển chip AI tùy chỉnh Jalapeño nhằm cạnh tranh với Nvidia Blackwell và Google TPU, nhắm vào workloads inference. Chip này đã được thử nghiệm với mô hình GPT-5.3-Codex-Spark và dự kiến triển khai vào cuối năm 2025, trong khi tình trạng thiếu hụt HBM đang ảnh hưởng đến biên lợi nhuận của Broadcom.

Lập trình viên nên đọc bài này để hiểu cách các công ty lớn như OpenAI và Broadcom hợp tác phát triển chip AI chuyên dụng, giúp tối ưu hóa hiệu suất cho các mô hình lớn như GPT-5.3, ảnh hưởng trực tiếp đến hiệu năng và chi phí của các ứng dụng AI trong tương lai.

How Businesses Are Building Specialized AI They Can Trust

NVIDIA ra mắt NVIDIA Agent Toolkit, một nền tảng mã nguồn mở và mô-đun giúp doanh nghiệp xây dựng các tác nhân AI chuyên biệt đáng tin cậy. Bộ công cụ tích hợp các mô hình Nemotron (tùy chỉnh lý luận), NemoClaw (đảm bảo hành vi an toàn) và OpenShell (thực thi bảo mật), được triển khai trong các lĩnh vực như y tế, an ninh mạng và thiết kế chip.

Lập trình viên chuyên về AI nên đọc bài này để hiểu cách xây dựng các hệ thống agent chuyên dụng, an toàn và có thể kiểm soát được, giúp họ ứng dụng kiến thức về mô hình open-source, bảo mật và tích hợp vào các dự án doanh nghiệp thực tế.

TensorX and Solstice line up $1bn to finance Europe’s sovereign AI buildout

TensorX and Solstice have announced a $1bn financing facility to fund AI hardware and data-centre capacity across the EU, targeting the growing demand for sovereign compute that stays on European soil. Alongside this, Solstice is launching aiUSX, a yield-bearing asset that lets companies put idle AI-earmarked capital to work as infrastructure lending. The product is capped at $5m at launch and is designed to generate yield that can later offset inference costs. Both companies operate within the Deus X Capital ecosystem, which positions itself as the connective tissue enabling the partnership.

3 Agents. 3 LLMs. 1 Aging GPU: Engineering Parallel Inference on Bare Metal

Running three different LLMs simultaneously on a single 8GB GPU fails because llama.cpp pre-allocates the full KV cache upfront, causing OOM errors for the second and third processes. The solution is a C++ daemon called lmxd that implements Connection Admission Control (borrowed from 5G/telecom) as a VRAM ledger: it tracks allocated bytes, enforces a 90% cap, and refuses new agent registrations before any GPU allocation is attempted. The daemon also handles KV-cache swapping to host RAM between agent switches, enabling multiple agents to share one GPU context slot. Additionally, a layer streaming technique using two CUDA streams overlaps compute and weight transfer, achieving ~22-32% wall-clock savings on a GTX 1080. The repo ships the admission control daemon and the streaming primitive as separate, composable components.

Databricks’ former AI chief thinks he can cut AI’s power bill by 1,000x

Unconventional AI, led by former Databricks AI chief Naveen Rao, has released Un0, an image-generation model built on a software simulation of a novel oscillator-based computing architecture. The company claims this architecture could reduce AI inference power consumption by up to 1,000x compared to conventional chips. Un0 performs comparably to state-of-the-art diffusion models like Stable Diffusion, serving as a proof-of-concept for the new architecture. The company plans to release actual chip schematics soon and eventually build a full inference stack, positioning itself as a compute provider running at a fraction of current energy costs.

The Ultimate Summer Sale Pairing: Steam Sale Meets GeForce NOW Discounts

NVIDIA's GeForce NOW is running summer membership discounts alongside the Steam Summer Sale, offering $70 off a 12-month Ultimate membership and $35 off a Performance membership. The Ultimate tier delivers RTX 4080/5080-class cloud performance at up to 4K/120fps with DLSS and ray tracing. Six new games join the GeForce NOW library this week, headlined by Devolver Digital's Dark Scrolls and Square Enix's The Adventures of Elliot: The Millennium Tales.

Nvidia accidentally made the RTX 50 series feel like a beta test for the RTX 60 series

The RTX 50 series launched with headline features like Multi Frame Generation, Ray Reconstruction, and Neural Texture Compression that were either unfinished or lacked broad software adoption. Months after launch, major fixes and updates are still arriving, and the most compelling exclusive features primarily benefit 4K gaming — a niche most PC gamers don't occupy. RTX 40-series owners already receive the biggest DLSS 4.5 image quality improvements, leaving the 50 series in an awkward middle ground. The author argues the generation feels like a transitional stepping stone, with the upcoming RTX 60 series (Rubin) positioned to be the hardware that fully realizes Nvidia's long-term rendering ambitions.