Portkey
Log in

Welcome to Portkey Forum

Updated 4 weeks ago

Prompt Caching by Anthropic

ss44002
·
to use prompt caching by anthropic, do we just include the promptcaching cache type ephemeral as they have specified??
V
s
2 comments
VVrushank | Portkey
Correct! Pass "cache_control": {"type": "ephemeral"} in the specific message body.

See this doc for more info: https://portkey.ai/docs/integrations/llms/anthropic/prompt-caching
ss44002
ok, thank you for such prompt support, i had rly not expected such fast response times
Add a reply
Sign up and join the conversation on Discord