AI Media Discovery: Store and retrieve extended media data in vector datatabase

Created on 7 September 2025, 7 days ago

Problem/Motivation

We can potentially capture and use extended data about media items, including: subjects and objects of the image; location information; contextual information from content usage; metrics on mood such as happiness and sadness; dominant colour information; lighting information.

With so much potential data it makes sense not to overwhelm editors and adversely affect performance by storing this data in regular Drupal fields, so vector databases are a likely approach.

Proposed resolution

Make it easy for developers creating Drupal AI tools to make use of extended data about media items by figuring out, developing, reviewing and documenting approaches.

Support a variety of data capture methods including JavaScript scanners, AI tools, imported data, EXIF data and manual input.

Support media find-ability and search-ability.

Remaining tasks

- List and provide examples of scenarios
- List and provide examples of technologies and tools
- Figure out and document how to configure things to achieve the scenarios with tools that already exist
- Describe potentially useful tools yet to be developed
- Validate the approaches with community review

🌱 Plan
Status

Active

Component

Planning

Created by

🇬🇧United Kingdom tonypaulbarker Leeds

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Production build 0.71.5 2024