Contrib.social

Proposal 2024: Drupal GenAI Orchestration Platform

Open on Drupal.org →
Created on 6 March 2024, 9 months ago
Updated 11 April 2024, 8 months ago

Mentor details

- Mentor's name: James Abrahams
https://www.drupal.org/u/yautja_cetanu → - Focusing on helping with the ideas, UI and general AI knowledge
- Mentor's name: Yan Loetzer
https://www.drupal.org/u/yanniboi → - Focusing on helping with the code

Project Description (min 2 to 5 sentences)

AI orchestration is the software that glues a LLM prompt and answer to some software that solves real problems. Quickly a pattern emerged of tools required to build real AI based solutions that can be found here: https://a16z.com/emerging-architectures-for-llm-applications/

There are a few proprietary and open source platforms that attempt to bring this all in one place (such as Palantir AIP) or solve bits of it such as flowise.ai. In the opensource world they usually only provide a very small slice of orchestration as they are tools built entirely from scratch. Drupal is in a good place to bring it all together with its powerful ontologically aware data structure of entities and fields on its community of modules.

  • Visual Prompt Editors: - ECA + BPMN module
  • Prompt Chaining and looping: - Workflows
  • Intelligent RAG: - Search API AI module , Views, User permissions, OCR
  • Validation through reporting and user feedback: - TODO
  • Model Agnostic: Single place to collect all the different models (Integration with llama.cpp?) - TODO
  • AI Agents - For example, if an e-mail comes in, Drupal works directly on the e-mail and does something with it using AI

Note there are a number of tools for using AI within Content. This is a seperate project to that. This is for AI working directly on entities and doing things within them according to some pre-defined process flow.

Project size

350 hours

Project Difficulty

INTERMEDIATE

Project Skills/Prerequisite

This is likely to need a good deal of back-end Drupal work but also basic front end and UI. The front-end UI work will be in the building back-end tools for site-builders rather than true front-end. Knowledge of LLMs and how they work and prompt engineering will be helpful but not a deep understanding of ML. Python might be helpful as most of the opensource tools already doing this will be written in python so being able to get python set up and read the code might help.

Project Goal

Push Drupal forward as a powerful orchestration platform. Making any of the above features more useful would be helpful. But showing that Drupal can be used to build an End-to-End AI application, such as a case management system would be a powerful showcase of how Drupal can utilise AI.

Project Resources

- https://a16z.com/emerging-architectures-for-llm-applications/
- https://flowiseai.com/

🌱 Plan
Status

Active

Component

Organization

Created by

🇬🇧United Kingdom yautja_cetanu

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

contrib.social Blog FAQ Discussions
Production build 0.71.5 2024