No valid stream events were sent. Make sure the events are using {text: string} or {html: string} format. You can also augment them using the responseInterceptor property: https://deepchat.dev/docs/interceptors#responseInterceptor

Created on 4 March 2025, 2 months ago

Problem/Motivation

When using the LMStudio Provider in Drupal AI Suite, I get this error during streaming responses:

No valid stream events were sent.
Make sure the events are using {text: string} or {html: string} format.
You can also augment them using the responseInterceptor property: https://deepchat.dev/docs/interceptors#responseInterceptor

The response does appear after refreshing the page, but the error itself appears whenever a live stream is attempted.

Steps to reproduce

Install and enable the LMStudio Provider module.
Enable and configure Drupal AI Suite to use LMStudio as the chat provider.
Initiate a chat through Drupal AI Suite with streaming enabled.
Observe the logs or the chat output for the error: "No valid stream events were sent."
Refresh the page and notice the final (non-streamed) message is displayed successfully.

Proposed resolution

LMStudio’s streaming output needs to be transformed to the {text: string} or {html: string} format that Deep Chat/Drupal AI Suite expects.

Implement a responseInterceptor to reshape LMStudio’s streamed chunks, for example:

responseInterceptor: (originalResponse) =&gt; {
  // Adjust the below line based on LMStudio response structure
  return [{ text: originalResponse.choices[0].message.content }];
}

This ensures each chunk in the stream is wrapped in a JSON object with a text property, eliminating the "No valid stream events were sent" error.

Remaining tasks

Update documentation or provide an example config/snippet for users integrating LMStudio with Drupal AI Suite.
Determine if LMStudio supports partial chunked responses or if additional handling is required for partial streaming.

User interface changes

No direct UI changes.

API changes

No direct API changes; just a format adjustment to streaming output.

Data model changes

None.

💬 Support request

Status

Needs review

Version

1.0

Component

Code

Created by

🇺🇸United States sushichris

Live updates comments and jobs are added and updated live.

stream

error

Comments & Activities

Issue created by @sushichris
Comment 2 months ago →
🇺🇸United States sushichris
Comment about 2 months ago →
🇺🇸United States ashrafabed
I get the same error when using the OpenAI provider. Mentioning in case it might make sense to have e.g. a Trait shared between the modules. I haven't dug into the code for this yet.

contrib.social Blog FAQ Discussions

Production build 0.71.5 2024