Limits by plan
Limits apply to validated inference requests — each call to
POST /infer counts as one request against your limit.Rate limit headers
Every response fromPOST /infer includes these headers:
Reading headers
Handling 429 Too Many Requests
When you exceed the limit, the API returns:Recommended retry strategy
- Read the
Retry-Afterheader and wait that many seconds before retrying. - Do not retry immediately in a tight loop — this will keep triggering the limit.
- For batch workloads, spread requests over time or use exponential backoff.
Python — respect Retry-After