Add Symfony Messenger Integration Module

Created on 11 December 2024, 11 days ago

Problem/Motivation

Create a new module (ai_messenger) that provides Symfony Messenger integration for background processing of AI operations, with Redis transport support and queue monitoring capabilities.

Long-running AI operations currently block the user interface and can timeout during execution. We need:

Asynchronous processing of AI operations
Reliable message queuing
Progress tracking for background tasks
Queue monitoring and management
Ability to handle process interruptions

Proposed resolution

New Module Structure
- Create ai_messenger module
- Implement Redis transport configuration
- Add queue monitoring capabilities
- Provide integration with Process Abstraction Layer
Core Features
- Message queue management
- Background worker processes
- Progress tracking integration
- Queue status monitoring
- Error handling and recovery
Configuration System
- Redis connection settings
- Worker process configuration
- Queue settings
- Retry policies
Monitoring Features
- Queue status overview
- Failed message handling
- Process monitoring
- Worker status tracking

Remaining tasks

Explore https://www.drupal.org/project/redis →

API changes

New service definitions
New configuration schema

🌱 Plan

Status

Active

Version

1.0

Component

Other Submodules

Created by

🇬🇧United Kingdom seogow

Live updates comments and jobs are added and updated live.

Comments & Activities

Issue created by @seogow
Comment 11 days ago →
🇬🇧United Kingdom MrDaleSmith
No problem with this idea, but it may make more sense as its own project rather than being part of the core AI module.
Comment 11 days ago →
🇬🇧United Kingdom scott_euser
Haven't looked at this in any detail, but to note there is https://www.drupal.org/project/sm → . I believe the idea is that the Queue system in Drupal can be leveraged and what is then used to processing queues is handled e.g. by that. In case there is any duplication of efforts

contrib.social Blog FAQ Discussions

Production build 0.71.5 2024