Assistant not giving proper response

Created on 18 September 2024, 4 months ago

Problem/Motivation

When I ask some follow-up question in the chatbot, it sometimes just gives a single line answer, something like -
Thank you for the question. I will search.
But then it does not give any other response.
An example follow up question:
Which of the above is available in Asia?
An example response:
Thank you for the question. I will search the RAG database for information on engines available in Asia.

It is not doing search based on the previous context.

Steps to reproduce

- Install AI module, configure VDB provider and assistant
- Configure Assistant to use "Session" in "Allow History".
- Talk to chatbot

Proposed resolution

TBD

Remaining tasks

NA

User interface changes

NA

API changes

NA

Data model changes

NA

📌 Task
Status

Active

Version

1.0

Component

Code

Created by

🇮🇳India Vivek Panicker Kolkata

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

  • Issue created by @Vivek Panicker
  • 🇮🇳India Vivek Panicker Kolkata

    I am on the dev version with commit ID "591c0ee59e50619861cb81fe39ddbb84a0d25dc9".
    The issue still exists.
    I am getting a mix of JSON and text explanation.
    I asked ChatGPT and it gave me the response: https://www.drupal.org/files/issues/2025-01-03/model_response.md

    So the idea that I liked here is that we can tell it to always respond in JSON.
    If some action is there, it will respond with the action key, if no action, then it will respond with some other key, eg. {text: ''}.

    Then in our code we can check if text or action and proceed accordingly.
    cc: @marcus_johansson

  • 🇬🇧United Kingdom MrDaleSmith

    We're probably going to need details of your set up to try and recreate this - the prompts used for the assistant and the set up of the VDB provider, and also your SAPI back-end. It would also be useful to have the questions you asked and the responses you expected.

Production build 0.71.5 2024