Throughput Reservation

​

Overview

• Capacity guarantee: The reserved TPM capacity is dedicated to your workload and is not shared with other users.
• Dedicated model code: After you create a Throughput Reservation, the system automatically generates a dedicated model code. You must replace the model parameter in your API requests with this code.
• Overflow strategy: When creating a reservation, you can choose how to handle excess traffic — automatically overflow to pay-as-you-go (default, no service interruption) or use reserved capacity only (excess requests return 429, no additional charges incurred).
• Add Capacity Package: Purchase additional capacity instances on top of an existing reservation. The new instance shares the same dedicated model code, and the total reserved capacity increases accordingly. See Management operations.
• 8-hour time-slot reservation: In Standard mode, you can opt for pre-paid (by 8-hour time slot), fixed at 8 hours and effective immediately, suitable for scenarios where load is concentrated in specific time slots. For more information, see Throughput Reservation billing.

​

Compare and select a plan

​

Supported models

​

Billing and usage notes

• Billing starts once deployment succeeds. Calls within the reserved capacity incur no additional charges. Prepaid fees are paid in a one-off upfront payment and remain in effect from the moment of purchase. Refer to the Bailian console for the actual charges.
• For the billing rules and sales constraints of the 8-hour time-slot reservation (pre-paid by 8-hour time slot), see Throughput Reservation billing.
• When the overflow policy is "Auto overflow": requests exceeding the quota degrade to standard pay-as-you-go billing without service interruption. You can view the degradation count on the detail page at Overflow degradation statistics. When set to "Reserved capacity only": requests exceeding the quota return 429 and incur no additional charges.
• Within 2 hours after the service expires, the instance can still be called and renewed; from 2 to 14 hours after expiry, the instance is stopped, cannot be called, but can still be renewed; after 14 hours, the instance is released and cannot be recovered. (Based on the daily reservation policy; the 8-hour time-slot reservation does not apply to this grace period. For details, see 8-hour time-slot reservation billing.)

​

Create a Throughput Reservation

On the Create Throughput Reservation page, fill in parameters including reservation name, model, billing cycle, input TPM, output TPM, purchase duration, auto-renewal on expiry, and overflow policy. The right side of the page provides a TPM capacity calculator to help with estimation.

1. Fill in the following parameters:

   Parameter	Description	Required	Value description
   Reservation name	Custom name for identification.	Yes	≤ 50 characters
   Select model	Select the model for which to reserve capacity. A dedicated model code is generated automatically upon submission.	Yes	Only models that support Throughput Reservation are available; refer to the console display.
   Performance mode	Inference performance tier that determines the output rate of the capacity.	Yes	Standard mode (same TPS as the standard API) / High-speed mode (PTU model deployment, 1.5–2× TPS improvement over the standard API)
   Billing cycle	Billing cycle.	Yes	Daily; 8-hour time slot (Standard mode only; fixed 8 hours, effective immediately. For details, see Throughput Reservation billing)
   Input TPM	Reserved input throughput, in kTPM (1 kTPM = 1,000 tokens/minute).	Yes	The starting value and step vary by model; refer to the console display.
   Output TPM	Reserved output throughput, in kTPM.	Yes	The starting value and step vary by model; refer to the console display.
   Purchase duration	Valid duration of the reservation.	Yes	Enter the number of days in the input box. Supported values: 1-30, 60, 90, 120, 365 days.
   Auto-renewal on expiry	Automatically deducts payment and renews at 08:00 one day before expiry. Enabled by default. The 8-hour time slot does not support renewal; this parameter does not apply.	No	On / Off
   Single renewal duration	Duration of each automatic renewal.	No	Enter the number of days in the input box. The value range is the same as the purchase duration.
   Overflow policy	How requests exceeding the reserved capacity are handled when it is exhausted.	Yes	Auto overflow to per-token pay-as-you-go (default; overflow switches to pay-as-you-go, no service interruption) / Reserved capacity only (overflow returns 429, no additional charges)

2. After confirming the parameters, click Buy now. In the fee confirmation dialog, verify the charges and click Confirm payment.
3. On the Overview tab of the Throughput Reservation detail page, find the Dedicated model code and click copy.
4. Replace the model parameter in your API request with the copied dedicated model code:

   Prerequisite: a Throughput Reservation instance has been created and its status is Running.

   The thinking_budget parameter of GLM-5.2 (which limits thinking length) does not take effect when called.

# When the request volume surges within a short period, the system needs a brief warm-up to match the required compute.
# During warm-up, some requests may experience latency fluctuations. Stability recovers after warm-up completes.
# Ensure you have request queuing or retry mechanisms in place.

import dashscope

response = dashscope.Generation.call(
    api_key="your-api-key",
    model="your-dedicated-model-code",   # Replace with your dedicated model code
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.output.text)

# When the request volume surges within a short period, the system needs a brief warm-up to match the required compute.
# During warm-up, some requests may experience latency fluctuations. Stability recovers after warm-up completes.
# Ensure you have request queuing or retry mechanisms in place.
curl -X POST https://dashscope.aliyuncs.com/compatible-mode/v1/chat/completions \
  -H "Authorization: Bearer $DASHSCOPE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"your-dedicated-model-code","messages":[{"role":"user","content":"Hello"}]}'

​

TPM capacity calculator

​

View and manage

On the Throughput Reservation page, each model card shows the active reservation count, reserved input/output TPM, and peak utilization ratio. The reservation list table includes columns for reservation ID, input/output TPM, status, billing method (daily, 8-hour time slot, hourly, etc.) and expiry date, and supports filtering by model, time, and status.

​

Reservation details

​

Management operations

• Add Capacity Package
• Scaling
• Renewal
• Unsubscribe

The Throughput Reservation page manages both TPM reservations and PTU (Provisioned Throughput Units); Add Capacity Packages apply to both. In the Active capacity instances area of a target card on the reservation list page, click Add Capacity Package to purchase an additional capacity instance on top of an existing reservation. After the addition, the reservation's total capacity equals the sum of the base reservation and all add-capacity packages; the dedicated model code remains unchanged, so no API changes are required.The dialog shows the following information inherited from the base reservation:

• Dedicated model code, base model, performance mode (Standard/High-speed), and overflow policy: inherited from the base reservation and cannot be changed.
• Existing packages: the number of capacity instances already added.

Fill in the following purchase parameters:

Parameter	Description	Required	Value description
Billing cycle	The billing cycle of the add-capacity package is constrained by the base reservation's billing method: if the base reservation is pre-paid, only pre-paid add-capacity packages can be selected; if the base reservation is post-paid, both pre-paid and post-paid add-capacity packages are available. High-speed mode supports post-paid or pre-paid; Standard mode only supports pre-paid (daily or 8-hour time slot).	Yes	Post-paid/Hourly / Pre-paid/Daily / Pre-paid/8-hour time slot (Standard mode only; capacity increases within the window and becomes invalid outside the window. For rules, see Throughput Reservation billing)
Input capacity	Added input throughput, in kTPM.	Yes	Starts at 10 kTPM, step 10 kTPM.
Output capacity	Added output throughput, in kTPM.	Yes	Starts at 1 kTPM, step 1 kTPM.
Purchase duration	Valid duration of the add-capacity package. Required only for Pre-paid/Daily; Post-paid/Hourly bills by actual duration and needs no entry.	Yes	1~30, 60, 90, 120, 365 days.
Auto-renewal on expiry	Applies only to Pre-paid/Daily. Automatically deducts payment and renews at 08:00 one day before expiry.	No	On / Off

A Model Code can have at most one non-deleted post-paid (hourly) capacity instance. If a post-paid instance already exists, the billing cycle for Add Capacity Package can only be Pre-paid/Daily.

The bottom shows the input reservation, output reservation fees, and total. After confirming, click Confirm purchase. After the purchase succeeds, the new capacity instance appears in the Active capacity instances list, and the total reserved capacity increases accordingly.

Click Scaling and adjust the input TPM and output TPM in the dialog.

Input TPM and output TPM can be set to 0: after zeroing, no capacity charges accrue and the dedicated model code is retained, avoiding code invalidation caused by expiry or unsubscription. However, zeroing is a downgrade, and the used portion is settled at a 1.2x coefficient for refund (see Billing and usage notes above).

Click Renew, select a renewal duration, and complete the payment. If Auto-renewal on expiry is enabled, the system automatically deducts payment and renews at 08:00 one day before expiry.

Click Unsubscribe and the system redirects to the Billing Center to complete the unsubscribe process.

Unsubscription is irreversible. After unsubscription, the dedicated model code becomes invalid and existing requests fall back to public resource processing. When unsubscribing, the used portion is settled at a 1.2x coefficient for refund. See the formula above.

​

FAQ