Moving 300GB of Request Details Out of Postgres Without Adding Complexity – DeadBro Blog

DeadBro, a Rails APM tool, faced a 300GB growth in a Postgres request details table within a single month, pushing OS drive usage to ~80%. Rather than spinning up a second Postgres instance, the team evaluated options including S3/Cloudflare R2 (too expensive at ~3M writes/day) and local disk (too tightly coupled to a single server). The chosen solution was self-hosted MinIO on a separate server, providing an S3-compatible API without per-write costs. A dual-write migration strategy was used — writing to both Postgres and MinIO simultaneously in staging and production before cutting over — ensuring no data loss. The result is a cleaner architecture where Postgres handles structured metadata and MinIO stores compressed JSON request payloads.

Nguồn: https://www.deadbro.com/blog/moving-large-json-request-payloads-from-postgres-to-minio. 8sync News chỉ tóm tắt và dẫn link; bản quyền nội dung thuộc tác giả và nguồn gốc.

Đề xuất cho bạn

Lobsters75 Hot3 phút5 ngày trướcAITop

Postgres Is Enough

Thư mục này lập luận rằng PostgreSQL có thể thay thế hầu hết các cơ sở dữ liệu chuyên dụng …

#postgresql#microservices#redis