Implementing Novita Ai: Navigating Configuration and Compatibility

Question

Hey, I'm trying to understand how to implement Novita AI. It's listed as a supported provider, but it's not included in the ENUM for a provider in the config. Does that matter? Is there are way to just use any OAI compatible llm?{ "strategy": { "mode": "loadbalance" }, "targets": [ { "provider": "novita", "api_key": "sk-***" }, { "provider": "novita-ai", "api_key": "sk-***" } ]
}https://docs.portkey.ai/docs/provider-endpoints/supported-providers

Griphook | Portkey · Answer

novita-ai should ideally work.tagging @Roydev to look into this

Roydev · Answer

checking the error @nerding-io Will update

Griphook | Portkey · Answer

Alternatively, If you need to use any other llm which is not officially supported, you can follow https://docs.portkey.ai/docs/welcome/integration-guides/byollm

Vrushank | Portkey · Answer

Hey @nerding-io - confirming that Novita AI should work. For the Config that you have above, it should ideally go through successfully. (i.e. if you attach this config as raw JSON to your request instead of the config slug, your request should already work)

We will update the docs for Novita shortly, and also update the ENUM for it in Configs.

Thank you so much for pointing this out!

nerding-io · Answer

Thanks!!!

Roydev · Answer

@nerding-io the issue should be fixed and available nowLet us know if there is any issue

nerding-io · Answer

Checked working thanks!!!

Welcome to Portkey Forum

Implementing Novita Ai: Navigating Configuration and Compatibility