Welcome to Portkey Forum

Home
Members
shockdav
s
shockdav
Offline, last seen 7 hours ago
Joined January 23, 2025
hey Team,

It seems the logs are not longer showing:

  1. Prompt
  2. User input
Now it is just showing the assistant response, is that intented?
Viewing the user input was extremely helpful. Now it takes us a lot more time to debug
3 comments
s
s
v
Hey Team,

Any chance you can integrate Flash 2.0 Light it came out this week from Gemini refer to https://developers.googleblog.com/en/gemini-2-family-expands/
2 comments
V
Gemini
Flash 1.5, 2.0,
OpenAI
4omini
and
Anthropic
Haiku 3.5.

I will be more than happy to provide any other information you need to facilitate this.
6 comments
V
s
How could I go about using a finetuned model? e.g I have a finetuned model on openai but it is not displayed on portkey UI.
I tried using your endpoints to refinetune the model eventhough it was succesfull it is still not available as an option in the UI.
I tried going to your finetune tab and it does gpt 4o mini is not an option.
5 comments
s
V
Hey! - How could I use tool_choice in prompts completion with anthopic models? I dont see any documentation around this topic

sql_completion = portkey.prompts.completions.create(
prompt_id="...",
variables={"user_query":". user_id=xxx"},
max_tokens=600,
temperature=0,
tools=sql_tool,
tool_choice={"type":"tool", "name": "sql_generator"}
)
15 comments
s
s
e