Enabling Structured Responses on Vertex AI Models

Question

is there a way to enable structured responses on vertex ai models? the UI on prompt library doesn't show an option like it shows for openai models

sega · Answer

tagging @Roydev for enabling json mode in the UI

Harold Senzei · Answer

@Roydev @sega @Vrushank | Portkey is there someother way to achieve this till its enabled on the ui?

Vrushank | Portkey · Answer

You can pass the tool details in your prompt.completions call

Vrushank | Portkey · Answer

like how you would generally pass it in the chat.completions method

Harold Senzei · Answer

Looks like the new prompt library added this feature

Roydev · Answer

@Harold Senzei let me know if there is any issue on above

Harold Senzei · Answer

No it is sorted for now, will update you if there is something

Welcome to Portkey Forum