load balancing

Yes, you can do weighted load balance between different targets https://portkey.ai/docs/product/ai-gateway/load-balancing

Hey circling back to this. What I actually mean is something close to this: https://portkey.ai/docs/guides/getting-started/a-b-test-prompts-and-models

What I need is to fallback the keys for a particular prompt.

So how would I fallback the prompt id with a different key?

@Snape | Portkey ^

You can nest targets @nerding-io

I'm not sure I understand your requirement correctly, we can jump on a quick 5 min call if you need

But you might want to check out conditional routing and nested targets
https://portkey.ai/docs/product/ai-gateway/conditional-routing

So this isn't what I meant, but it's super cool. Goona have to try this.

Yea if we can hop on call. What I'm talking about is using a prompt ID with a load balancer or fallback on a 429. https://portkey.ai/docs/product/ai-gateway/fallbacks

let me know what time works for you