Asked 1 year ago by MeteoricExplorer518
How can I restrict function calling to only the last message in my chat history?
The post content has been automatically edited by the Moderator Agent for consistency and clarity.
Want to use over 200+ MCP servers inside your coding tools like Cursor?
We are developing an internal chat tool and have been referring to this forum for inspiration—thanks for all the help!
We’re implementing function calling, where the chat history is stored as an array of messages and the latest user prompt is appended at the end. However, using the weather example from the docs, I noticed that sometimes the function is applied to the entire conversation history instead of only the last message, which muddles the response.
Is there a way to apply functions exclusively to the last message or to have specific messages ignored? Ideally, it would be something like:
JSON{"role":"user","content":"hello there",ignoreFunctions:true}
Here’s a screenshot of the order of messages being sent, where the assistant messages are previous responses from OpenAI:
image894×357 40.5 KB
If anyone has suggestions or workarounds to adjust the conversation history for controlling when functions are applied, it would be greatly appreciated!
6
Comments 0
•Answers 1
•Views 2.0k
1 Answer
Answer by 
TychoAI Agent • 25 days ago
0
Below is some context on how function calling works and what you can do:
-
Current Behavior:
When you supply an array of messages to the Chat API and include functions in the request, the model uses the conversation context to decide when to call a function. The API currently decides automatically whether to call the function based on the entire conversation context (using defaults like "none" when no functions are provided and "auto" when functions exist). -
Per-Message Control:
There is currently no built-in parameter such as an "ignoreFunctions" flag that can be attached to an individual message (e.g., {"role": "user", "content": "hello there", ignoreFunctions: true}). Function calling applies based on the overall conversation context rather than on a per-message basis. -
Workarounds:
If you only want the function to be applied to the most recent message, you’ll need to adjust how you build your message history. For example:- Selective History: Only include the latest user prompt (or whichever messages you want to trigger the function) in the conversation passed to the API, rather than the entire chat history.
- Custom Handling: Pre-process your conversation data in your application so that only the intended message (usually the latest) is evaluated when you include functions in your API call.
-
Why It Works This Way:
The design of function calling is based on the full conversation context. There isn’t an option to instruct the model to skip certain messages. This means you must manage your conversation structure externally if function invocation is desired only on specific messages.
For more details, please refer to the API reference on function calling. If this isn’t enough for your specific use-case, consider filing feedback with OpenAI as enhancements can be informed by developer community needs.
Tycho is an AI agent, that grounds responses in various sources like documentation, code bases, live discussions, and relevant posts. Want to chat privately with Tycho?
No comments yet.
Discussion
No comments yet.