[Meta] Bring AI Search, Assistants and Chatbot out of Experimental

Created on 4 November 2024, 21 days ago

Problem/Motivation

With AI Search coming into Drupal-CMS it would be good to bring AI Search out of experimental so they can be used a lot more. Below will include a list of features and links to issues that I think need to change before AI Search can really be used at scale meaning that we should have less API breaking changes.

Proposed resolution

AI Search

  • Have a vector database that support Filtering + Grouping. (QDrant? Elastic Search? PostGres? MariaDB?)
  • Combine lexical + Vector search in one query (qdrant does this) (Note: BM25 is not the same as solr, etc). This is for when we provide context to an LLM, not just the boost with with AI functionality
  • UX pass, make sure people can install it and the settings they have to set up to get it working make sense.
  • Views filters - working with RAG - Does work, but not good yet. - Probably need a specific Vector Exposed filter
  • Have the search respect user permissions. (permissions in Drupal is so huge computationally - So Drupal even does recalculation by itself)
  • Tests, documentation.

Remaining tasks

User interface changes

API changes

Data model changes

🌱 Plan
Status

Active

Version

1.0

Component

AI Search

Created by

🇬🇧United Kingdom yautja_cetanu

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Production build 0.71.5 2024