Contrib.social

Add optional RAW vectors in RAG results

Open on Drupal.org →
Created on 19 May 2025, 16 days ago

Problem / Motivation

The AI VDB provider plugin manager currently discovers embedding providers but does not expose which field is used to store raw embeddings (at least I didn't find it). As a result, Search API AI backends cannot conditionally include raw vectors in their output, leading to fatal errors when a backend expects a vector field that the provider did not return.

Proposed resolution

  1. Add an optional method getRawEmbeddingFieldName() to the VDB provider plugin interface.
  2. If implemented, this method returns the name of the field containing raw embeddings; otherwise it returns NULL.
  3. Extend the Search API AI search backend UI with a checkbox “Include raw embedding vector” (default off).
  4. When checked and the provider implements getRawEmbeddingFieldName(), include that field in the search result output.

User interface changes

  • In the Search API AI search backend settings form, add a checkbox:
    Include raw embeddings.
  • Provide descriptive help text: “When enabled and supported by your VDB provider, raw embedding vectors will be returned in each result.”
✨ Feature request
Status

Active

Version

1.2

Component

Code

Created by

🇪🇸Spain Nikro Benalmadena, Malaga

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

contrib.social Blog FAQ Discussions
Production build 0.71.5 2024