Alibaba Cloud Bailian Throughput Reservation documentation directory, including the Throughput Reservation overview, creation, integration and management, long input and prefix caching, 8-hour periods and stacked capacity packages, as well as billing and API references.
Throughput Reservation locks dedicated inference capacity for a specified model, ensuring your business is unaffected by public rate limits during peak hours. Related documentation:
- Throughput Reservation overview: product concepts, Standard/Express mode comparison, supported models, and FAQs.
- Create, integrate, and manage: console creation workflow, parameters, integration and invocation via three protocols, viewing monitoring and scaling, renewal, and unsubscription.
- Long input and prefix caching: cache conversion coefficients, long input tiers, the TPM capacity calculator, and capacity consumption fields.
- 8-hour periods and stacked capacity package billing: rules for 8-hour period reservations and stacked capacity package billing.
- Throughput Reservation billing: pricing, scaling, unsubscription refunds, and expiration rules.
- Throughput Reservation API reference: OpenAPI management interfaces for Throughput Reservation.