Articles tagged: distributed inference

3 articles

AI tools

Reducing Rollout Bottlenecks in Reinforcement Learning with NVIDIA Dynamo

NVIDIA Dynamo addresses reinforcement learning rollout bottlenecks through KV-aware routing, ModelExpress weight distribution, and recover...

Nov 20, 20265 min
AI agents

Agent Substrate: Advancing Kubernetes for Agents at Scale

Agent Substrate addresses Kubernetes limitations for idle AI agents by multiplexing sessions over warm worker pools. This CNCF Sandbox pro...

Nov 11, 20267 min
AI tools

Build a Validated Kubernetes Runtime for NVIDIA Dynamo

NVIDIA AI Cluster Runtime (AICR) packages NVIDIA Dynamo into validated recipes to simplify Kubernetes deployment. This approach ensures GP...

Oct 31, 20266 min