[Meta] AI Image Classification

Created on 15 September 2025, about 1 month ago
Updated 26 September 2025, about 1 month ago

Problem Statement

Currently, Drupal lacks automated image classification capabilities, making it difficult to organize, search, and discover media content at scale. As AI-powered content discovery becomes increasingly important, we need a foundation for automatically describing and tagging images to enable future RAG (Retrieval-Augmented Generation) and similar AI-driven functionalities.

Proposed Solution

Implement AI-powered image classification functionality that automatically generates descriptions and tags for media images, creating a searchable and well-organized media library that can support advanced AI features.

Goals

  • Enable Future AI Functionality: Establish proper image classification as the foundation for advanced AI features in Drupal
  • Improve Content Discoverability: Allow images to be discovered and retrieved using RAG and similar AI techniques through proper classification and descriptions
  • Automate Media Organization: Reduce manual effort required to organize and describe media content

MVP Requirements

Core Functionality

  • Manual Classification Button: Add a "Classify Image" button to media image entities that triggers AI analysis and automatically populates:
    • Image description field
    • Classification tags from taxonomy (not just words, but descriptive values)

Configuration & Setup

  • Recipe Implementation: Create a Drupal recipe that:
    • Adds a new taxonomy vocabulary for image classification
    • Adds a description field to the media/image bundle
    • Configures the classification functionality

Bulk Operations

  • Batch Processing: Implement bulk operation to classify multiple images simultaneously for existing media libraries

Technical Considerations

Fields Required

  • Description Field: Long text field for AI-generated image descriptions
  • Classification Tags: Taxonomy reference field linking to image classification vocabulary

User Experience

  • Single-click classification for individual images
  • Progress indicators for bulk operations
  • Clear feedback on classification results
  • Option to review/edit AI-generated content before saving

Post-MVP Functionality

  • Automatic classification on image upload
  • Classification confidence scoring
  • Advanced tagging hierarchies and relationships

Acceptance Criteria

  • [ ] Recipe successfully adds description field and taxonomy to media/image bundle
  • [ ] "Classify Image" button appears on media image edit forms
  • [ ] Button triggers AI classification and populates description and tags
  • [ ] Bulk operation available in media library for multiple image classification
  • [ ] All functionality works with existing media entities
  • [ ] Proper error handling and user feedback implemented

Dependencies

  • AI service integration (external API or local model)
  • Media module (core)
  • Taxonomy module (core)

Priority

High - Foundation for future AI functionality initiatives

🌱 Plan
Status

Active

Component

Code

Created by

🇩🇪Germany breidert

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Not all content is available!

It's likely this issue predates Contrib.social: some issue and comment data are missing.

No activities found.

Production build 0.71.5 2024