Portkey
Log in

Welcome to Portkey Forum

Updated 2 months ago

Passing Metadata with Prompt/Completions Endpoint Using Portkey Python SDK

At a glance
HHarold Senzei
·
How do we pass metadata with prompt/completions endpoint? The sdk forces the headers to empty dict https://github.com/Portkey-AI/portkey-python-sdk/blob/1174d2f45be2f3559927b719d406e2fdb264a44f/portkey_ai/api_resources/apis/generation.py#L249
H
s
5 comments
HHarold Senzei
One solution I found is to create a copy of the client for each request using .with_options and pass the metadata.

Would this be the correct approach?
ssega
yes! with_options is the correct way
ssega
if you dont want to initialize the client again
ssega
but internally it also creates another client instance only
HHarold Senzei
any specific reason the headers are being set to {} in the sdk? if they were not removed we can pass the metadata using header kwarg
Add a reply
Sign up and join the conversation on Discord