[Meta] AI Image Classification

Created on 15 September 2025, 24 days ago
Updated 26 September 2025, 13 days ago

Problem Statement

Currently, Drupal lacks automated image classification capabilities, making it difficult to organize, search, and discover media content at scale. As AI-powered content discovery becomes increasingly important, we need a foundation for automatically describing and tagging images to enable future RAG (Retrieval-Augmented Generation) and similar AI-driven functionalities.

Proposed Solution

Implement AI-powered image classification functionality that automatically generates descriptions and tags for media images, creating a searchable and well-organized media library that can support advanced AI features.

Goals

  • Enable Future AI Functionality: Establish proper image classification as the foundation for advanced AI features in Drupal
  • Improve Content Discoverability: Allow images to be discovered and retrieved using RAG and similar AI techniques through proper classification and descriptions
  • Automate Media Organization: Reduce manual effort required to organize and describe media content

MVP Requirements

Core Functionality

  • Manual Classification Button: Add a "Classify Image" button to media image entities that triggers AI analysis and automatically populates:
    • Image description field
    • Classification tags from taxonomy (not just words, but descriptive values)

Configuration & Setup

  • Recipe Implementation: Create a Drupal recipe that:
    • Adds a new taxonomy vocabulary for image classification
    • Adds a description field to the media/image bundle
    • Configures the classification functionality

Bulk Operations

  • Batch Processing: Implement bulk operation to classify multiple images simultaneously for existing media libraries

Technical Considerations

Fields Required

  • Description Field: Long text field for AI-generated image descriptions
  • Classification Tags: Taxonomy reference field linking to image classification vocabulary

User Experience

  • Single-click classification for individual images
  • Progress indicators for bulk operations
  • Clear feedback on classification results
  • Option to review/edit AI-generated content before saving

Post-MVP Functionality

  • Automatic classification on image upload
  • Classification confidence scoring
  • Advanced tagging hierarchies and relationships

Acceptance Criteria

  • [ ] Recipe successfully adds description field and taxonomy to media/image bundle
  • [ ] "Classify Image" button appears on media image edit forms
  • [ ] Button triggers AI classification and populates description and tags
  • [ ] Bulk operation available in media library for multiple image classification
  • [ ] All functionality works with existing media entities
  • [ ] Proper error handling and user feedback implemented

Dependencies

  • AI service integration (external API or local model)
  • Media module (core)
  • Taxonomy module (core)

Priority

High - Foundation for future AI functionality initiatives

🌱 Plan
Status

Active

Component

Code

Created by

🇩🇪Germany breidert

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Not all content is available!

It's likely this issue predates Contrib.social: some issue and comment data are missing.

No activities found.

Production build 0.71.5 2024