Skip to main content
Instances run always-on with CPU throttling, so they wake in milliseconds and cost little when idle. As traffic grows, you can scale capacity to handle more concurrent load.

Tiers

Two different problems call for two different solutions. If traffic is growing and requests are queuing up, you need more replicas — that’s horizontal scaling (covered below). If a single request is slow because the workload itself is heavy (large model inference, complex data transforms), you need a larger tier with more CPU or memory. The tier table below helps you pick the right baseline for each instance. Each instance runs on a tier that sets its baseline CPU and memory:
If the requested tier has no capacity, the deploy or scale operation returns HTTP 503. The platform does not fall back to a different tier.

Scaling via the API

Scale a running instance to adjust replicas. The permanent endpoint stays the same and load is distributed across replicas.

Parameters

integer
required
Number of replicas to run behind the permanent endpoint.

Response

string
The scaled instance.
integer
Current replica count after scaling.
string
Instance state (remains running).

Choosing a tier

If a single request is slow, a larger tier may help more than additional replicas. If throughput (concurrent requests) is the bottleneck, increase replicas.
No. The permanent endpoint stays the same. Traffic is balanced across replicas.
Use stop to halt all traffic. Scaling to zero replicas is equivalent to stopping the instance.
The operation returns HTTP 503. Retry after a delay or choose a different tier.

Limits & quotas

Numeric limits depend on your plan — see the Console.

Errors

Common mistakes

  • Scaling instead of choosing the right tier. If a single request is slow, a larger tier helps more than more replicas.
  • Over-provisioning early. Scale to observed load, not anticipated peaks.

Best practices

  • Watch metrics before and after scaling.
  • Scale based on concurrency and latency, not raw request counts alone.
  • Keep production and development instances on separate environments.

Instances

Deploy and manage instances.

Runtime Lifecycle

How instances stay healthy and recover.

Metrics

Measure load and latency.

Tiers & Limits

Tier capacities and account limits.

Next steps

Continue to Sessions & Filesystems.