Refactor the Assistants Prompt Configuration

Created on 19 November 2024, about 1 month ago

Problem/Motivation

There are a number of ways in which the structure of the AI Assistants page can be improved.

Proposed resolution

Below is a list of changes:

  • Change Description to be "Administrative Description" - Add a short 1-2 sentence description of what this AI Assistant does. This is not used in the prompt at all and is primarily for site admins. If for any reason the assistant is called by an AI this description may be used to help another AI agent understand this Assistant.
  • Move Administrative Description, Allow History and History Context length down to above "Advanced" LLM
  • Remove Pre-prompt System Role from the form and from the advanced meta prompt
  • Change "Pre-Prompt Instructions" to "Instructions" (Note we will include this in the pre-action and post-action system prompts - What does this Assistant do? How does it behave? What should it avoid doing? These instructions are sent to the AI alongside any user messages to help it know how it is supposed to respond. It is good to start by telling it a role such as "You are a Drupal assistant helping users understand how to use Drupal"
  • Change the "Assistant Message" to "Post-action message" and have it as an advanced message inside the AI Agents. (Do we even need it). If there is a RAG call then the post-action message can be different for RAG. I'm wondering if this should be config in the agent itself.
  • Error Message should be moved into advanced settings
  • Advanced LLM should be changed to "AI Provider" - I don't think end-users will understand our distinction. - The provider of the AI models used by this assistant. You will only be able to select the advanced models that are capable of providing the responses the Assistant needs.
  • Pre-Action Prompt should be changed to "System Prompt" and include within it a token for the "Pre-action prompt"
  • We should have a new "Pre-action prompt" field that is similarly not editable with the specific information about how to handle pre-actions.
  • The new System prompt should now always be the system prompt for every single Assistant call. It can just have different things put in it depending on the stage it is at. (So Pre-action prompt can be removed when its in post-action).
  • We can have a post-action prompt too although that might be best inside the agents.
  • We should make the context that is provided configuration within advanced settings. Perhaps in a further drop-down. Anything with PII should be removed such as username and e-mail and perhaps even the URL of the site.
📌 Task
Status

Active

Version

1.0

Component

AI Assistants API

Created by

🇬🇧United Kingdom yautja_cetanu

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

Production build 0.71.5 2024