Feedback management with trace id

I have one question regarding feedback.

Right now i am creating feedback using this code

const feedback = await portkey.feedback.create({
        traceID: "test-trace-id",
        value: 6,
        weight: 2,
    })

if i call this code 4 times with same trace id then i can see 4 different values

I my application i have upvote and downvote button. If user upvote generation and then downvote then last upvote should be replaced with the downvote so i can see it properly in analytics.
In portkey i am not able to replace the previous feedback. It is just adding it stack and considering all the values when i check the graphs.

How do i handle this scenario.

Attachment

Screenshot_2024-04-03_at_10.03.59_AM.png

3 comments

VVrushank | Portkey

Thanks for sharing @Het007! Agree that this is useful. Shared with the team, and will get back on how we are thinking of solving this. Btw, thanks to your nudge, we added a "Support" button on the app now! 😄

Parallely, would love to understand how you use Analytics for Feedbacks right now - as in which charts specifically are useful to you and what insights do you derive from them?

HHet007

Thanks @Vrushank | Portkey I am not using Analytics right now but i am planning to use it with portkey.
My use case is really simple. I just want to see input outputs of llm with user feedback.

VVrushank | Portkey

Gotcha!

Add a reply

Welcome to Portkey Forum

Feedback management with trace id