Contrib.social

[META] XB AI Capabilities

Open on Drupal.org →
Created on 7 April 2025, 15 days ago

Overview

Integrating AI capabilities is crucial to meet user expectations for seamless site building and content creation. Many site builders and content editors desire intuitive tools to quickly form and refine their ideas without technical barriers. Currently, multiple teams are developing AI extensions that address these needs, but in fragmented ways. This risks creating a suboptimal experience due to fragmentation.

By including advanced AI features directly within Experience Builder itself, we can offer users a unified, streamlined approach that requires no extensive setup or additional customization. This will allow teams to rapidly prototype, iterate, and publish content without losing focus on the core site-building process.

Proposed resolution

Phase 1: Foundations for AI enabled capabilities

Initial UI/UX

  • Define how AI suggestions, prompts, and generative content will appear within Experience Builder.
  • Facilitate both text based interactions as well as more complex UIs, e.g., for previewing and selecting between options

Establish an framework for integrating AI capabilities

  • Define a baseline architecture for AI interactions.
  • Integrate with the existing AI modules to allow relying on several AI models.

Phase 2: Implement Baseline Functionality in Experience Builder

AI-Assisted Site Building

  • Allow generating code components via AI prompts
  • Generate a content type template via AI prompts using an existing content type.
  • Get help from AI on using Experience Builder

AI-Assisted Content Creation

  • Generate a section using components inside component library via AI prompts
  • Generate and refine page copy via AI prompts
  • Generate metatags for a page based on page content
  • Get help from AI on using Experience Builder

Examples of extensions

Some of these could be agents, simply integrating with text based prompts. Some of these could have more complex UIs.

  1. Figma to Drupal
  2. Optimize for SEO
  3. Generate content
  4. Generate an image
  5. Search for images inside media library
  6. Translate content
  7. Build document / image as XB page
🌱 Plan
Status

Active

Version

0.0

Component

Project management

Created by

🇫🇮Finland lauriii Finland

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

  • Issue created by @lauriii
  • Comment 14 days ago →
    🇺🇸United States Kristen Pol Santa Cruz, CA, USA

    Didn't make the meeting due to time but thanks for putting this together. I'll watch the meeting recording soon.

    For those who aren't aware, some of these have been part of the "AI Migration Initiative" that's been going on for a few weeks that Suchi+I have been helping wrangle. We had a meeting yesterday to discuss and have been organizing that.

    The main thing we've been focused on from list in the issue summary is the Figma to Drupal work which is a huge thing that incorporates MCP integration, code component generation, etc.

    Obviously, we'll need to make sure we are all aligned and not duplicating work.

  • Comment 14 days ago →
    🇺🇸United States Kristen Pol Santa Cruz, CA, USA

    Watched the recording and went through the notes from the meeting. I'll continue to keep in the loop on the Figma to Drupal stuff via Jamie and see how that is splitting out from the AI Migration group.

contrib.social Blog FAQ Discussions
Production build 0.71.5 2024