Tiers
Two different problems call for two different solutions. If traffic is growing and requests are queuing up, you need more replicas — that’s horizontal scaling (covered below). If a single request is slow because the workload itself is heavy (large model inference, complex data transforms), you need a larger tier with more CPU or memory. The tier table below helps you pick the right baseline for each instance. Each instance runs on a tier that sets its baseline CPU and memory:Scaling via the API
Scale a running instance to adjust replicas. The permanent endpoint stays the same and load is distributed across replicas.- CLI
- curl
Parameters
integer
required
Number of replicas to run behind the permanent endpoint.
Response
string
The scaled instance.
integer
Current replica count after scaling.
string
Instance state (remains
running).Choosing a tier
If a single request is slow, a larger tier may help more than additional replicas. If throughput (concurrent requests) is the bottleneck, increase replicas.
Does scaling change the endpoint?
Does scaling change the endpoint?
No. The permanent endpoint stays the same. Traffic is balanced across replicas.
Can I scale to zero?
Can I scale to zero?
Use
stop to halt all traffic. Scaling to zero replicas is equivalent to stopping the instance.Limits & quotas
Numeric limits depend on your plan — see the Console.
Errors
Common mistakes
- Scaling instead of choosing the right tier. If a single request is slow, a larger tier helps more than more replicas.
- Over-provisioning early. Scale to observed load, not anticipated peaks.
Best practices
- Watch metrics before and after scaling.
- Scale based on concurrency and latency, not raw request counts alone.
- Keep production and development instances on separate environments.
Related pages
Instances
Deploy and manage instances.
Runtime Lifecycle
How instances stay healthy and recover.
Metrics
Measure load and latency.
Tiers & Limits
Tier capacities and account limits.

