@Vrushank | Portkey Hi! I am noticing

Question

Hi! I am noticing that the system prompt is missing in the logging when using Anthropic and Portkey as a proxy. Anthropic uses the parameter system rather than a system message like OpenAI does. I think you might not be picking up any system parameter when working as proxy mode. This also affects reported token count

Additionally, the response is JSON-only

Vrushank | Portkey · Answer

Unfortunately, @Yorick this is expected behaviour, as Anthropic's /messages route is not supported on Portkey. This is by design - we make it work on the Gateway's /chat/completions route instead.

In this case, Portkey just acts as a dumb proxy for your requests and other features like cost metrics, fallbacks, caching etc. will not be supported.

Vrushank | Portkey · Answer

I'd suggest to move to using the Portkey SDK or the OpenAI SDK with Portkey to call Anthropic.

Though I do want to understand @Yorick if there are any critical features with Anthropic SDK that we are missing out on Portkey

Yorick · Answer

I am using Vercel's AI SDK. That is why I need to proxy

Yorick · Answer

@Vrushank | Portkey So you see this message above

Vrushank | Portkey · Answer

Got it, @Yorick - give me a day, and I'll get back to you on the Vercel AI support for Portkey

Vrushank | Portkey · Answer

Sorry for the delay here!!

Welcome to Portkey Forum

@Vrushank | Portkey Hi! I am noticing