Welcome to Portkey Forum

Updated 8 months ago

@Team Portkey - i tried the anthropic

@Team Portkey - i tried the anthropic models using portkey today. i keep getting an internal server error - 05 when i use anthropic, but it works on open ai models. is it possible for you guys to propogate the error message back to the user interface?
V
r
t
27 comments
Portkey does no modifications on the provider errors. It is likely in this case that this may be an Anthropic error. Though would it be possible for you to share either the trace id or the code snippet that you're using? I'll check and share if there are any bugs!
@thismlguy - the log view in Portkey should ideally give you the error response. Is that not coming through?
doesnt show up in the logs
same thing happened again
no entry in logs
trace id should be bae6e117-fa8f-4f19-99a3-d8e72a05fa2f
it seems to be a portkey error
Can you also share the code snippet you're using to make the call?
You can DM it as well
i think i got the issue, it basically happens when i send 2 consequitive assistant messages
seems like anthropic doesn't support that
there was another case where a correct error was thrown
not sure why the same wasn't caught on the first case
code snippet is not straight forward to share
a7867d20-16c8-41a4-9658-3294b716e9dd
this trace id on your logs worked for gpt4
and gave the internal server error for anthropic
btw, i think my trace ids are getting overwritten, does it have to be unique?
cc @visarg who can check this
Oh interesting, yes - for Anthropic you can't send two consecutive assistant messages. Glad you found the issue
Not necessarily - Portkey adds trace IDs for logs where you don't send one yourself. Whenever you send one along with the request, we use that instead of adding a Portkey generated one.

Is that not what's happening?
i am setting a trace id but its not showing up
let me double check my code
it was an issue on my side
Add a reply
Sign up and join the conversation on Discord