AI At Home Part 1: A Box Of Scraps

A software developer builds a homemade AI inference server using cheap e-waste AMD V620 workstation GPUs (originally overproduced for failed cloud-gaming projects), a salvaged 2017 X299 motherboard, and off-brand Arduino fan controllers running custom PWM code. After wrestling with BIOS settings (Resizable BAR, MMIO High Size), no-fan server GPUs, and a deafening 10,000 RPM fan setup, the rig successfully boots Ubuntu 24.04 and runs llama.cpp with Gemma4 and Deepseek V4 Flash models. The build is part one of a series, with the next installment covering performance tuning.

Source: https://jdagostino.github.io/ai-pt1-box-o-scraps/index.html. 8 Sync News only summarizes and links out; content copyright belongs to the authors and original sources.