Skip to main content

Throughput Reservation

Alibaba Cloud Bailian Throughput Reservation documentation directory, including the Throughput Reservation overview, creation, integration and management, long input and prefix caching, 8-hour periods and stacked capacity packages, as well as billing and API references.

Throughput Reservation locks dedicated inference capacity for a specified model, ensuring your business is unaffected by public rate limits during peak hours. Related documentation: Quick start:
  1. Create a throughput reservation and copy the dedicated model code.
  2. Replace the model parameter to make an invocation.
  3. Verify that service_tier hits the reserved capacity.