Open up Assistant for naive RAG and for direction agent communication

Created on 6 March 2025, about 1 month ago

Problem/Motivation

Currently the AI Assistant is a solution that are using two LLM calls on any usage to it - one to figure out if the Assistant needs to take action, and a second one if the Assistant took some actions. Thats the pre-action prompt and then the assistant message.

This is great for complex workflows where you need to compare RAG databases or have a multi agent workflow, however it sucks if the only thing you want to do is naive RAG or talk directly to an agent or some other direct action.

If you always for instance want the chat message (+ possible chat history) to be sent to the RAG search or if you want the instructions to go directly to an agent, the first so called pre-action prompt is unneccesary and might just cause confusion.

If the user only chooses one action, they should have the possibility to push the instructions directly, without the pre-action prompt.

Proposed resolution

On the AI Assistant form, add an checkbox that says something in the line of "Always use action with chat message".
In the AI Assistants runner, form the runner JSON manually with the chat message in the history and skip the pre-action message if this setting is set.

📌 Task
Status

Active

Version

1.1

Component

AI Assistants API

Created by

🇩🇪Germany marcus_johansson

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

Production build 0.71.5 2024