Fallbacks
Avoid downtime with failover models
Keywords AI will catch any errors occurring in a request to model and fall back to the list of models you specified in the fallback
field. This is useful to avoid downtime and ensure that your application is always available.
If all your fallback models also fail, Keywords AI will continue to catch the error if you have safety net enabled.
Fallback Logic with Retries
Below is the pseudo-code for the fallback logic with retries:
- To learn more about how
generate_response_with_load_balance
works, see the Load Balancing section. - To learn more about how
filter_by_hard_requirements
works, see the Model Filtering section.