Request rate limits (QPS) for each RAG API endpoint and how to handle throttling.
Each endpoint has a request rate limit (QPS, requests per second) to protect service stability. When you go over, the endpoint returns HTTP
Rate limits for Knowledge Search (
When you hit a rate limit, the endpoint returns:
Recommendations:
429 Too Many Requests.
Knowledge Base management endpoints
| Endpoint | Path | QPS limit |
|---|---|---|
| Retrieve | /rag/index/retrieve | 2,000 |
| Get Job Status | /rag/index_job/status | 20 |
| List Documents | /rag/index/files | 15 |
| Document Details | /rag/list/index/file/details | 10 |
| Create Knowledge Base and Import | /rag/index/create_v2 | 10 |
| Submit Import Job | /rag/index/job/create | 10 |
| List Knowledge Bases | /rag/index/list | 10 |
| Update Knowledge Base | /rag/index/update | 10 |
| Delete Knowledge Base | /rag/index/delete | 10 |
| Delete Document | /rag/index/delete_file | 10 |
| List Chunks | /pipeline/{id}/chunklist | 10 |
| Update Chunk | /rag/index/chunk/update | 10 |
| Delete Chunks | /rag/index/chunk/delete | 10 |
| Monitoring | /rag/index/monitor | 1 |
Data Import endpoints
| Endpoint | Path | QPS limit |
|---|---|---|
| Describe File | /describeFile | 10 |
| Delete File | /deleteFile | 10 |
| Request Upload Lease | /applyFileUploadLease | 10 |
| Register File | /addFile | 10 |
| List Categories | /listCategory | 5 |
| Create Category | /addCategory | 5 |
| Delete Category | /deleteCategory | 5 |
| List Files | /listFile | 5 |
| Get Connector | /getConnector | 5 |
| Batch Update Tags | /batchUpdateFileTag | 5 |
| Create Connector | /addConnector | 2 |
| Import from OSS | /addFilesFromAuthorizedOss | 5 |
Knowledge Search and Chat
Rate limits for Knowledge Search (/knowledge/search) and Knowledge Chat (/knowledge/chat) are not published yet — to be updated.
Handling rate limits
When you hit a rate limit, the endpoint returns:
- On a 429, back off exponentially before retrying — for example, 1s → 2s → 4s.
- Cap concurrency on batch operations so you don't burst past the limit.
- Cache results client-side for low-QPS endpoints like Monitoring to cut down on calls.