AI Media Discovery: Investigate JavaScript scanners as a method of extracting information from images

Problem/Motivation

We can potentially capture and use extended data about media items, including: subjects and objects of the image; location information; contextual information from content usage; metrics on mood such as happiness and sadness; dominant colour information; lighting information.

Perhaps JavaScript tools like those used in Editoria11y module and OpenCV.js face-api.js can be a useful part of the AI mix, save resources by performing some work without using AI services and integrate with AI services.

Proposed resolution

Investigate available tools and their relative merits. Investigate whether different tools can integrate with different AI service providers
(examples Azure computer vision https://learn.microsoft.com/en-us/azure/ai-services/computer-vision/ https://learn.microsoft.com/en-us/rest/api/computer-vision/
and Google Cloud Vision https://cloud.google.com/vision/docs )

Remaining tasks

- Investigate and explore capabilities of JS libraries and tools
- Investigate and explore capabilities of AI provider tools
- Document general findings
- Provide code examples and technical information that can be used to help realise stories in the AI media track.