Skip to main content
Routing and modes control where and how a fleet runs. Choosing the right combination directly affects cost, latency, and isolation. A dev/test fleet might use serverless mode with cold starts allowed; a production fleet handling sensitive data might need dedicated compute in a VPC with an always-on pool. This page lays out the options so you can make that tradeoff deliberately. A fleet’s runtime behavior is governed by five configuration dimensions: deployment mode, routing policy, capacity profile, isolation profile, and egress policy. Together they determine cost, latency, resilience, and security posture.

​
Deployment modes

How the fleet’s compute capacity is provisioned.

​
Routing policies

How incoming work is distributed.

​
Capacity profiles

The responsiveness-versus-cost tradeoff.

​
Isolation profiles

How fleet workloads are isolated from each other.

​
Egress policies

What outbound network access is permitted.

​
Choosing a configuration

Start conservative (serverless / cold_start_ok) and tighten as load patterns become clear. You can view fleet configuration with client.orchestrator.fleet.get() but changes are made through the Console.
always_on + dedicated has the highest baseline cost but lowest latency variance. serverless + cold_start_ok has near-zero idle cost but occasional cold-start latency. fluid + warm_pool balances the two for most production workloads.
Use geo routing with fluid or dedicated mode to serve users from the nearest region. Combine with failover for resilience across regions.

​
Choosing a configuration

Start conservative and tighten as traffic becomes predictable. Reserve always_on for latency-critical fleets — it minimizes cold starts but maximizes idle cost.
A primary_region is required when you create a fleet. Routing policies such as geo and failover build on it to place and fail over work.

Fleets

Where these settings apply.

Tasks

Work that runs under these settings.

Fleets (concept)

The conceptual model.

Billing & Usage

How configuration affects cost.

​
Next steps

Continue to Approvals.