Welcome to Portkey Forum

Updated 6 months ago

The issue with using Anthropic Claude 2 on AWS bedrocks

Also can someone please tell me what's the issue here?

I am trying to use the Anthropic Claude 2 using AWS bedrocks, I am facing problem a Claude 2, 2.1 and llama models while Sonet & Haiku are running fine.

Attachment

4 comments

VVrushank | Portkey

@W ï l l ¥ Confirming that Portkey supports Claude 2, 2.1 Llama models.

I think there could be 2 issues -

Are these models enabled on your Bedrock account? AWS generally requires you to manually enable each new account, hence.
There may be a problem in your chat.completions request - if you can share the relevant code snippet here, can take a look!

WW ï l l ¥

Here is the prompt

Attachment

Screenshot_2024-06-03_at_11.31.40_PM.png

VVrushank | Portkey

Just confirming that the Claude 2.1 model is enabled in the models list on Bedrock

Attachment

WW ï l l ¥

I will confirm with my team admin and get back to you if it still doesn't work.

Add a reply