,

AgentCore Runtime V2: Scale-to-Zero Agents That Bill Right

AgentCore Runtime V2 scale-to-zero agents with a low usage meter

AgentCore Runtime V2 fixes the two things that kept serverless AI agents out of serious production conversations: slow cold starts and a bill sized for the worst case. AWS shipped the new runtime to general availability on September 18, 2026 inside Amazon Bedrock AgentCore. If your teams are building agents, or running them on a container cluster because “serverless was too slow,” this is worth fifteen minutes of your leadership meeting.

Why AgentCore Runtime V2 matters to the business

Agents have an awkward usage profile. Traffic is spiky, sessions are long and unpredictable, and memory use swings wildly depending on what the model decides to do. That’s the worst possible shape for “provision a fleet and keep it warm,” and it’s the best possible shape for serverless, as long as serverless is fast enough and priced sanely.

The original AgentCore Runtime got the isolation and scale-to-zero parts right: each session runs in its own microVM with hardware-enforced isolation, and you pay nothing when nobody’s talking to your agent. What it got wrong was the wait. According to AWS’s launch write-up, V1 cold starts ran from about 5.4 seconds to 30 seconds depending on how large the agent’s container image was. Nobody keeps a customer-facing chat window open for 30 seconds of nothing.

V2 brings that down to roughly 1.9 to 2.0 seconds at P75 for images from 200 MB up to 2 GB. The platform captures a snapshot of the agent after it initializes, and every new session restores from that snapshot instead of booting from scratch. The practical upshot: image size, which used to be the main driver of startup delay, mostly stops mattering.

Paying for what the agent actually uses

The more interesting change for finance is the billing meter. V1 charged memory based on the peak you reserved, which means you paid for the biggest request an agent might ever handle, on every session, all the time. It’s the cloud equivalent of renting a moving truck to buy groceries.

V2 uses elastic memory: memory is loaded into the agent’s microVM when it’s needed and reclaimed when the agent goes idle. You’re billed on memory actually loaded. The per-GB rate is higher than V1, but the footprint is smaller, and AWS’s own guidance is that for most agents the bill goes down. Note the word “most.” An agent that sits at a high, constant memory footprint for its whole session will see less benefit. Ask your team to pull real session profiles and run the math against the current AgentCore pricing before anyone quotes savings in a board deck.

What doesn’t change: still no pre-provisioning, still scale-to-zero, still no minimum fleet to babysit. Idle agents cost nothing on the runtime line.

Paying for memory actually used versus reserved peak capacity for AI agents

Cold starts are a product problem, not just an engineering one

It’s tempting to file cold-start latency under “engineering detail.” Don’t. For an internal copilot, a 20-second first response is the difference between people using it every day and people quietly going back to the old workflow. For a customer-facing agent, it shows up in abandonment rates and support escalations. Adoption is the whole ROI story for most AI initiatives, and first-response latency is one of the most visible parts of that experience.

Two seconds at P75 won’t win any awards, but it moves the platform from “noticeably sluggish” to “the model is the slow part,” which is where you want to be. AWS also measured agent code execution at about 34 ms P75 once restored, so the runtime itself is no longer eating the latency budget.

Serverless agents vs. running your own cluster

Plenty of teams landed agents on Amazon ECS or EKS because the serverless option was too slow. That made sense a month ago. Here’s how the trade now looks:

  • Cost shape. A cluster charges you for capacity whether anyone’s using the agent or not. AgentCore Runtime V2 charges for active sessions and the memory they actually touch. For spiky or low-volume agents, serverless wins easily. For a single agent running hot around the clock, the gap narrows, and it’s worth modeling.
  • Isolation. Every AgentCore session gets its own microVM. Getting equivalent per-session isolation on a shared cluster takes real engineering effort and ongoing care. For agents that touch customer data or run tools with side effects, that isolation is a security and compliance asset you don’t have to build.
  • Operational load. No node groups, no autoscaling policies, no patching cadence for the hosts. Your platform team gets that time back.
  • Control. A cluster gives you more knobs: instance types, networking tricks, custom sidecars. If you really need those, you already know it. Most agent teams don’t.

The roadmap, and the risk of opting in early

AWS has publicly flagged what’s coming next: committed baseline pricing (predictable spend for steady workloads), x86 microVMs, session suspend and resume, and scoped identity. Committed pricing in particular will matter to anyone whose finance team hates variable bills. None of it is available today, so treat it as direction, not a plan of record.

So what’s the risk of moving now? Lower than usual for a new runtime, for three reasons:

  • It’s opt-in per agent. Teams set a single platform version setting to V2 on an agent. Other agents stay where they are.
  • Callers don’t notice. The way applications invoke the agent doesn’t change, so there’s no client-side migration.
  • It’s reversible. Agent updates create new versions, so rolling back is a configuration change rather than a rebuild.

The real risk is subtler: because V2 reuses a snapshot of the initialized agent across sessions, code that assumed a fresh start every time (for example, generating unique IDs or fetching credentials at startup) needs review. That’s a code-review item, not a re-architecture, but make sure someone owns it.

Also check geography. At launch, V2 runs in us-east-1, us-east-2, us-west-2, eu-west-1, and ap-northeast-1. If your data residency rules put agents elsewhere, you’re waiting.

What we’d do this quarter

Pick one agent with real traffic and a visible cold-start complaint. Have the team move it to AgentCore Runtime V2, review startup code for snapshot safety, and measure three things for two weeks: P75 first-response latency, runtime cost per thousand sessions, and user engagement. If the numbers land the way AWS says they will, make V2 the default for new agents and put the cluster-hosted ones on a migration list. The AgentCore documentation and the platform versions guide give your engineers everything they need to start.

At Enkompass (enkompass.net), this is our home turf. We build serverless, event-driven systems that scale to zero and bill like it, and we’re already moving client agents onto the new runtime. If you’d rather have seasoned cloud people handle it instead of learning the hard way at 2 AM, let’s talk. Reach out through our contact page or call us directly at +1-828-436-5667 — we’ll help you turn this from a someday-project into a done-deal.

Ready when you are

Let’s map your route to AWS

A free 60-minute architecture review with a senior engineer. No slides, no SDR, just a plan.