Welcome to Portkey Forum

Home
Members
nerding-io
n
nerding-io
Offline, last seen 2 weeks ago
Joined November 4, 2024
Hey is it possible to create a config to load balance, canary test, with virtual keys specifcally for a prompt id?
8 comments
n
G
Hey, I'm trying to understand how to implement Novita AI. It's listed as a supported provider, but it's not included in the ENUM for a provider in the config.

Does that matter? Is there are way to just use any OAI compatible llm?

Plain Text
{
    "strategy": {
        "mode": "loadbalance"
    },
    "targets": [
        {
            "provider": "novita",
            "api_key": "sk-***"
        },
        {
            "provider": "novita-ai",
            "api_key": "sk-***"
        }
    ]
}


https://docs.portkey.ai/docs/provider-endpoints/supported-providers
7 comments
n
R
V
G