Stop Request Stampedes with Gateway Request Deduplication

Platformatic Gateway now includes request deduplication to solve the thundering herd problem. When many concurrent requests hit the same uncached route, only one request goes upstream while the rest wait and receive the same response. The feature uses a leader/waiter model with configurable storage (in-memory or Valkey for horizontal scaling), route whitelisting, custom key functions, and TTL-based deadlock prevention. Benchmarks show 10,000 requests reduced to just 100 upstream calls. Built-in metrics (leader, waiter, replay, fallback counts) let teams verify production impact. Particularly useful for self-hosted Next.js apps handling cache-cold traffic spikes.

Nguồn: https://blog.platformatic.dev/gateway-request-deduplication-nodejs. 8sync News chỉ tóm tắt và dẫn link; bản quyền nội dung thuộc tác giả và nguồn gốc.

Đề xuất cho bạn

API Evangelist0 Hot14 phút21 giờ trước

Kong Konnect Has Two Front Doors and Neither One Is the One I Want

An exploration of Kong Konnect's two API authentication surfaces — the platform admin API (using personal access tokens) and the Dev Portal developer API (using portalaccesstokens) — and why neither enables fully automated, agent-first onboarding. The author benchmarks Kong against SoundCloud's programmatic onboarding flow and finds Kong lands in a 'paste a token' bucket: the first credential still requires a human clicking through a UI. A complete Node.js script is provided that automates everything after that bootstrap step, supporting both admin listing and developer application registration with Key-Auth or OIDC/DCR credentials. The post closes with a call for Kong to publish a stable, documented public developer portal API that lets agents onboard end-to-end without manual console interaction.

#authentication#oauth