Traffic Management
Rate limit
When an LLM call is rate limited, our system detects the error and retries the request to prevent failovers.
You can set rate limits for each model and API key. See our rate limit configuration guide for detailed instructions.