Welcome to Portkey Forum

Updated 10 months ago

function calling API

When using a function calling API within chat completions. We could use tools to specify a function specification and get a structured function argument. I also read that we can select a tool_choice in the consequent calls to LLM.

Does this mean the LLMs providers remember the tools you've defined forever?
S
2 comments
For example, messages is something LLMs or LLM providers don't remember. Developers keep on appending the context, for better response from the LLM. So I was wondering how come tools happen not having to append anything in consequent calls...
🟒 I somehow missed apps pass tools again along with tool_choice. My query is solved.
Add a reply
Sign up and join the conversation on Discord