Does Portkey have any way to enable Cache Control for all requests sent for Anthropic API? Like there's now a simple button in the playground, so maybe some config option that will add all input to the cache control. Basically to try and make it work like OpenAI's caching; automatic and always on.
The way we're using Portkey with HARPA AI, we don't really have a way to set cache control otherwise, so we can't use caching.
Hi, just want to confirm that regular email addresses are not allowed to sign up for Portkey? I signed up via my domain mail, but a friend was trying to sign up and couldn't do it with their regular Gmail address.
I've noticed something strange. I've been testing the new OpenAI Prompt Caching on its o1 mini models, using Portkey.
Every few requests, one of the requests has zero cache tokens. Even though it should have cache tokens because the message history is the same.
The previous message would have the cache, and the next one would have the cache too.
I'm wondering if this is an issue with OpenAI, or Portkey? Could it be that Portkey is sending the request from a different IP or something else that causes the cache to not work?
OpenAI doesn't give detailed enough logs for me to check what happened there :/
Hi im using Gemini API via a config in Portkey. I specifically set up the categories to 'block none', but still it seems some of the requests get blocked, and plus it doesn't even show up in the Logs. and Automatic Retry doesn't seem to work on this either. Is there any way around this? At least to be able to log the requests that are getting blocked?
