Challenges with Data Update and Tool Invocation in Agentic flow.

[sanidhyabitcot]

Hi everyone,

I’m facing a challenge with my agent setup.

Current Flow and Challenges

Current Flow

In the current flow, we have a single agent that utilizes two tools based on the query requirements:

Update_Employee_Details Tool

This tool is responsible for adding or updating data in the database(Postgres SQL).

Flow:
User Question → LLM Chain (SQL Query Generation) → Set Variable (update_sqlQuery) → Custom Function (Execute SQL) → Prompt Template (Format Response) → LLM Chain (Generate Final Response) → Chain Tool (Update_Employee_Details) → Conversational Agent

---

Fetch_Employee_Details Tool

This tool retrieves or fetches data from the database.

Flow:
User Question → LLM Chain (SQL Query Generation) → Set Variable (fetch_sqlQuery) → Custom Function (Execute SQL) → Prompt Template (Format Response) → LLM Chain (Generate Final Response) → Chain Tool (Fetch_Employee_Details) → Conversational Agent

---

Challenges

1. Issue with Data Update Queries

   • Initially, the flow worked as expected for data update queries.
   • However, now, while the data is being updated in the database, the chat response inaccurately states that either the data was not found or the tool was unable to perform the update.

2. Unexpected Tool Invocation

   • Debugging logs revealed that both tools are being invoked during a query, even though only the Update_Employee_Details tool should be triggered in such cases.

3. Challenges with Sequential Data Addition

   • When adding data one record at a time, the agent invokes the tool for each entry.
   • By the end, the agent becomes inconsistent and inserts irrelevant data into the database.

4. Prompt Modification Impacts

   • Modifying the prompt to address specific use cases often leads to breaking other use cases, which has been a significant challenge.

---

Request for Assistance

Could anyone help me understand how to avoid this recursive behavior and improve the flow logic to ensure agents only communicate as needed?
Any suggestions or insights would be greatly appreciated.

Thanks!