Agent Substrate shares warm workers across stateful agent sessions
Agent Substrate maps many stateful agent sessions onto a smaller pool of warm Kubernetes workers. When a session becomes idle, it saves memory and filesystem state; a later turn restores that session onto an available worker instead of creating another pod. NVIDIA describes how inference-wait signals could coordinate this lifecycle, while explicitly noting that GPU support and parts of its Dynamo integration remain experimental.
NVIDIA Technical Blog · Nov 10, 2026
Why it matters
Keeping session state does not have to mean reserving a full warm worker while an agent waits for a person or model.
More context
The independent CNCF Sandbox project supports sandboxed actors and bounded request parking when workers are busy. Platform teams can inspect a CPU-sandbox prototype before attempting GPU integration. Its APIs are still changing, and proposed GPU restore needs compatible devices or a fallback cold start; cluster capacity and storage are separate costs.
Keep in mind
This is evolving infrastructure, not a verified isolation or density guarantee. The article includes planned work alongside landed changes, so confirm implementation status before designing around a capability.
Original read