Welcome to Portkey Forum

Updated 3 months ago

Anthropic Latency with base64 image prompt

After trying few times i started gettign response under 6 seconds but it is unrelible. Some calls are still taking 15 seconds some are completing under 5 seconds. All the calls have same data and it is not hitting the catch

13 comments

GGriphook | Portkey

GGriphook | Portkey

Hey @Het007 are you getting widely different response times if you use the anthropic api directly (not the console) and through the gateway?

GGriphook | Portkey

the gateway does not add more than a few milli seconds of latency to the request, so any latency would be from anthropic itself

GGriphook | Portkey

Also we have a cool status page for anthropic https://status.portkey.ai/

HHet007

Thanks @sega I think this is issue with frontend. When i cancel the process and click on generate button again the response start coming in.

HHet007

no. i am getting the consistant response there

HHet007

Is there other way to pass image on anthropic with portkey? Or the one i am using is the correct one.

GGriphook | Portkey

you are using it the correct way, anthropic only accepts base64 encoded strings. We will verify what the issue with the prompt playground is. Meanwhile you can make the request using the SDK/API if it's a problem

HHet007

Okay Thanks!

GGriphook | Portkey

Hey @Het007 are you still facing the issue? I've tried to debug, I did not notice any additional latency for prompting with images in anthropic from the dashboard

HHet007

No i am also not facing any delay now

HHet007

Thanks

GGriphook | Portkey

great!

Add a reply