Contrib.social

Chatbot - Missing continue button?

Open on Drupal.org →
Created on 13 August 2025, 3 months ago

Problem/Motivation

Question for maintainers, with DeepChat setup and RAG(Milvus) I often have to reply to get the agent to actually search, at first I just waited thinking it was going to search and a few seconds later reply but nothing ever happened. Is this a bug? When it says " I will search for... " is it expected to do nothing until the user chats something? Seems like its missing a "continue" button or something but i don't see any JS errors.

Steps to reproduce (required for bugs, but not feature requests)

Please provide information like AI modules enabled, which AI provider, browser, etc.
AI Assistant - Milvus for RAG, gpt-4o

Proposed resolution

Is this a prompt/instructions issue?

Remaining tasks

Optional: Other details as applicable (e.g., User interface changes, API changes, Data model changes)

🐛 Bug report
Status

Active

Version

1.0

Component

AI Chatbot

Created by

🇺🇸United States NicholasS

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

  • Issue created by @NicholasS
  • Comment 3 months ago →
    🇺🇸United States NicholasS

    So for other who stumble on this issue it seem the problem is the default "Stream" behavior, if you disable the stream the chatbot almost never does this anymore. Bug lies I think in the decoder sometimes the action comes in too late.

    Looking at the code in PromptJsonDecoder.php lines 55-75, it only tests the first 10 chunks for JSON markers like {, [, etc. If those markers aren't in the first few chunks (because the AI started with conversational text), it assumes it's not JSON.

    Simple Solution: Turn of streaming if your primarily using it for RAG.

  • Comment 2 months ago →
    🇺🇸United States NicholasS

    Clarify title since I think I know what is going on as I experiment more with it.

  • Comment about 2 months ago →
    🇺🇸United States NicholasS

    So as usage continues turning off streaming helps but does not fully fix the issue, users still occasionally experience this issue.

  • Status changed to Closed: outdated 5 days ago
contrib.social Blog FAQ Discussions
Production build 0.71.5 2024