Portkey
Log in

Welcome to Portkey Forum

Updated 9 months ago

Fallback feature for language model integrations

SSaif
·
The Fallback feature allows you to specify a list of Language Model APIs (LLMs) in a prioritized order. If the primary LLM fails to respond or encounters an error, Portkey will automatically fallback to the next LLM in the list, ensuring your application's robustness and reliability.
At https://portkey.ai/docs/product/ai-gateway-streamline-llm-integrations/fallbacks

or encounters an error
Should I assume any other response code outside of 2XX will trigger fallbacks?
V
S
3 comments
VVrushank | Portkey
Correct! You can set specific error codes that trigger Fallback or not set specific error codes - in which case Portkey will trigger fallback for any and all errors
SSaif
Awesome. A request for documentation to list the default error codes that portkey considers as errors and applies fallback when the user doesn't mention them explicitly using on_status_codes. 🙂
VVrushank | Portkey
Done! Check out the docs
Add a reply
Sign up and join the conversation on Discord