How do we describe the AI module in a short sentence?

Created on 20 June 2024, 8 days ago
Updated 21 June 2024, 7 days ago

Problem/Motivation

There is so much the AI module can do and we're having to give lots of talks about it. That it would be good if we could have some ideas or community consensus on the best way to describe the AI module / initiative itself and the important sub-modules. I've come up with something but not happy with it at all.

Proposed resolution

Inspiration from Webform: "The Webform module provides all the features expected from an enterprise proprietary form builder combined with the flexibility and openness of Drupal."

Current descriptions from module page.

AI Module: The AI module provides all the foundational features you will need to build powerful and magical AI powered features or applications, from the simple to the complex with little to no code. Whilst giving you expected out of the box functionality to get you started.

AI Search: Search through your content intelligently where the search understands the meaning of your terms with Semantic Search or ask a LLM Chatbot to explore your content, find it or answer questions about it. By integrating embeddings and vector databases into Search API we can reduce hallucinations in your LLMs or provide it access to more of your own data in what is known as β€œRetrieval Augmented Generation.

AI Automators: In the standard Drupal way of starting with Fields you can use LLMs to populate and change any field in Drupal. This quickly becomes the starting point to create complex and meaningful AI applications where prompts can be changed together in as simple or complex a workflow as you need. With ECA and Widgets this can be extended further to create complex workflows or helpful AI widgets inside your content.

We may also need a separation of detailed description and simple description.

Simple

AI Module: The AI module enables you to build powerful AI powered applications, with no code! Providing out of the box functionality, as simple as pressing a button using a multiple of supported providers.

AI Search: Search based on the meaning of your words or use AI ask questions about your content with reduced hallucinations. Pluggable so you can use RAG with any embeddings, vector databases or LLM agents you want including fully self-hosted.

AI Automators: A no/ low code approach to automation in Drupal. Complex applications built quickly and simply in a way familiar to anyone who is used to Drupal and fields. Automators can use AI to populate fields, pull information from tokens and use external services for context.

Remaining tasks

Any ideas and suggestions?

🌱 Plan
Status

Active

Version

1.0

Component

Discussion

Created by

πŸ‡¬πŸ‡§United Kingdom yautja_cetanu

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

  • Issue created by @yautja_cetanu
  • πŸ‡¬πŸ‡§United Kingdom yautja_cetanu
  • πŸ‡΅πŸ‡ΉPortugal Catia_Penas

    I was thinking of something not overly complex just to the point.

    β€œThe AI module enables you to build powerful AI powered applications, with no code! Providing out of the box functionality, as simple as pressing a button.”

    Just an idea.

  • πŸ‡¬πŸ‡§United Kingdom yautja_cetanu
  • πŸ‡¬πŸ‡§United Kingdom yautja_cetanu

    I think the things that need be said about the AI module (But maybe this is overkill)

    • Provides tools to build complex AI applications
    • Provides simple functionality out of the box
    • Pluggable, abstraction layer so any model can be used

    Do we need this? Is abstraction layer implied? Its cool now because all the other modules don't have one but the more this gets used it will be taken for granted it has one. Search API doesn't need to go on and on about abstraction layer?

    This is how Search API describes itself:

    "This module provides a framework for easily creating searches on any entity known to Drupal, using any kind of search engine. For site administrators, it is a great alternative to other search solutions, since it already incorporates facetting support and the ability to use the Views module for displaying search results, filters, etc. Also, with the Apache Solr integration, a high-performance search engine is available for this module.

    Developers, on the other hand, will be impressed by the large flexibility and numerous ways of extension the module provides. Hence, the growing number of additional contrib modules, providing additional functionality or helping users customize some aspects of the search process.
    "

  • πŸ‡§πŸ‡ͺBelgium wouters_f Leuven

    Inspired by the intro from search_api (and a bit from token and metatag)

    This module provides a framework for easily applying Artificial Intelligence ino Drupal, using any kind of AI model.
    Editors can use their LLM/GPT/model of choice for generating or manipulating content and Developers will find the framework easy to use and extend. The AI module enables very simple AI implementations (enable and forget) and complex workflows (eca/ai automator).

    AI submodules

    The explanation here for all the submodules.

    Features

    • list of features each linking to more details or docs β†’
    • LLM in ckeditor
    • Image generation (in ckeditor)
    • Image generation (image field)
    • Image generation (media field)
    • Image manipulation
    • RAG (chat with your content)
    • ECA integration

    And much much more.

    Using AI Programatically

    An example for the old school developers

    ai('text_completion', 'Summarize the following text in 2 sentences: ' .  $input_text);
    

    How it should be done using the service:

    \Drupal::service('ai.provider')->getInstance('dreamstudio')->textToImage('A cow with earrings', 'sd3')->getRawOutput();
    

    Make sure to check the developer documentation or the api.php file for more examples.

  • πŸ‡±πŸ‡ΉLithuania mindaugasd

    AI may be the module all other will depend on, so a go-to solution to build anything on top.

    It can be promoted module already has AI abstraction layer and other features to empower developers to build their apps. Also allows to quickly prompt AI for non developers.

    Maybe like I do on my project pages, what already exist, and what is planned, what is consider. Maybe its not the best example, but its clear what to expect. For now AI module is already usable for as a developer framework to base contrib modules on top.

    The AI module serves as the cornerstone for developing a wide range of AI-powered applications, from simple automations to complex AI systems. It offers essential tools, immediate out-of-the-box functionality, and supports various AI providers through a flexible abstraction layer. This versatility makes it the go-to solution for any AI integration in Drupal

    I asked AI to generate some more good ones, but I am not polishing too much, because those features are not here yet:

    • The AI module provides the foundational tools needed to build powerful AI applications, from simple to complex, with minimal to no coding required. It offers plug-and-play functionality and supports multiple AI providers through a unified abstraction layer.
    • AI Search enhances your content discovery by understanding the meaning behind search terms through Semantic Search. Utilize an LLM Chatbot to explore, retrieve, or answer queries about your content. [... also add another sentence with keywords for developers like embeddings, vector etc.]
    • AI Automators integrate seamlessly with Drupal fields, allowing you to use LLMs to populate and modify any field. Create simple or complex applications by chaining prompts together. Extend functionality with ECA and Widgets to develop comprehensive workflows or AI-powered content widgets.

    But I also very interested in this issue, because I am to add a separate section on initiative page as in the draft (above the pyramid) #3372486: Project description β†’ But it also needs a square logo as Kevin described here #3453674-7: Logo for the project page β†’

  • πŸ‡ΊπŸ‡ΈUnited States nicxvan

    Here is my attempt that might be worth working into the first part of wouters_f's description.

    The AI module allows you to combine several different AI services into a workflow chain that matches your needs. You can specify the order services are used and what triggers the chain to begin.

    It might be worth mentioning that the configuration occurs on the field level.

  • πŸ‡ͺπŸ‡ΈSpain AlvaroDeMendoza

    I think what @mindaugasd says its so powerful. (The one in the quote)

  • πŸ‡ΊπŸ‡ΈUnited States nicxvan

    I agree that @mindaugasd's quote seems right.

  • πŸ‡¬πŸ‡§United Kingdom yautja_cetanu

    Ok! I'll go with that quote on the module page and Dev Days Talk for now!

Production build 0.69.0 2024