Upbound Unfurls Control Plane for Managing AI Inference Workloads

Upbound has launched Modelplane, an open source control plane built on Crossplane that lets IT teams manage AI inference engines using the same declarative workflows they use for Kubernetes clusters. Modelplane supports deploying inference engines based on available GPU capacity across cluster fleets, autoscaling replicas, caching and distributing model weights, and routing inference requests through a unified gateway. Available under Apache 2 license with no usage caps, it aims to integrate AI inference workload management into existing cloud-native operations without requiring specialized staff.

Nguồn: https://cloudnativenow.com/features/upbound-unfurls-control-plane-for-managing-ai-inference-workloads. 8 Sync News chỉ tóm tắt và dẫn link; bản quyền nội dung thuộc tác giả và nguồn gốc.