Welcome to Portkey Forum

H
Het007
Offline, last seen last week
Joined November 4, 2024
How do i use prompt-catching with port-key and bedrock. This catch control setting is not available when i choose bedrock.

https://portkey.ai/docs/integrations/llms/anthropic/prompt-caching
2 comments
H
b
I’m using Sonnet v2 with AWS Bedrock in the us-east-1 region. It seems that invocation is only supported with an inference profile for Sonnet v2, and I need to set this as the model ID: us.anthropic.claude-3-5-sonnet-20241022-v2:0.

However, in Portkey, all the model IDs start with anthropic.XXX instead of us.XXX. How do I configure portkey with inference profile.
13 comments
V
H
V
Hi, I am facing an issue while uploading an image through portkey. So right now I am trying to pass two different image one image is 90 KB and another image is 790 KB. Whenever I pass 90 KB image, I am getting the response successfully but Whenever I pass 790 KB image I am getting the above error.

I tried both of these image in anthropic console and its working there. One issue can happen is that I am using the online base 64 image encoder maybe it could be causing the issue but again I am also encoding 90 KB image there and it is working.(https://www.base64-image.de/)
9 comments
H
V
After trying few times i started gettign response under 6 seconds but it is unrelible. Some calls are still taking 15 seconds some are completing under 5 seconds. All the calls have same data and it is not hitting the catch
13 comments
G
H
this feedback inside logs is in random order. not sure if that's a bug or intensional. but i think showing this logs in most recent first order would be more user friendly.
4 comments
R
H
V
i think it's helpful if i can customise this column. I don't need Model name or path here as it will going to be same in my application. I want to display promptId here.
If i can configure this columns and order of the column then it would make this dashboard more user friendly.
2 comments
H
V
I have one question regarding feedback.

Right now i am creating feedback using this code

const feedback = await portkey.feedback.create({ traceID: "test-trace-id", value: 6, weight: 2, })

if i call this code 4 times with same trace id then i can see 4 different values

I my application i have upvote and downvote button. If user upvote generation and then downvote then last upvote should be replaced with the downvote so i can see it properly in analytics.
In portkey i am not able to replace the previous feedback. It is just adding it stack and considering all the values when i check the graphs.

How do i handle this scenario.
3 comments
H
V