Welcome to Portkey Forum

Updated 12 months ago

Default cache duration

aayush-portkey

Default is 7 days.
Where are you trying the cache_status parameter?

7 comments

ddeepanshu_11

using with llama index, but its not working @ayush-portkey

aayush-portkey

Possible to share your code snippet?

ddeepanshu_11

Sure

ddeepanshu_11

Plain Text

portkey_client = Portkey(
    mode="single",
    api_key=PORTKEY_API_KEY
)
portkey_client.add_llms(pk.LLMOptions(provider="openai", model="gpt-4-1106-preview", virtual_key="xyz", cache_status="simple", cache_age=6000))
service_context = ServiceContext.from_defaults(llm=portkey_client, embed_model=OpenAIEmbedding(model="text-embedding-ada-002"))
set_global_service_context(service_context)

ddeepanshu_11

^ @ayush-portkey

aayush-portkey

We have figured the issue @deepanshu_11, cache config is getting dropped in this case. Fixing it asap.
Thanks for reporting.

ddeepanshu_11

Hello @ayush-portkey thanks for taking this up! Any updates on this?

Add a reply