Contrib.social

Actionable hallucinations happen from time to time

Open on Drupal.org →
Created on 28 August 2025, about 1 month ago

Overview

While testing other issues I saw that around 10-20% of the time the orchestraition agent would say that it will process or do something and just get stuck there, without actually using any tool call.

See the following screenshot as an example:

→

For an end user that does not have developer tools or some other debugging tool, they might just sit and wait for the AI to do something and get frustrated when it says something, but doesn't take action.

This is testable using OpenAI gpt-4.1. It's not reproducable using Anthropic models.

There were two direct issues I could see that would cause this - one is that the tool description for the experience_builder_component_agent is very unclear. Tool descriptions are generally more important than system prompts for picking the right tool and to big prompts can lead context overflow, where it stops following instructions.

The other issue is that we need to be more specific that it always needs to take action/use a tool, when it claims that it does or have done.

Proposed resolution

Fix the system prompt and the description.

🐛 Bug report
Status

Active

Version

1.0

Component

AI

Created by

🇩🇪Germany marcus_johansson

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

contrib.social Blog FAQ Discussions
Production build 0.71.5 2024