- Issue created by @ubulinux
Mentor: Unassigned
Project Summary:
This project aims to create a unified AI-driven module for Drupal that not only audits and remediates accessibility issues across text, layout, and media but also enhances media content by generating AI-powered captions and descriptive alternative texts. By merging capabilities from an AI-Powered Accessibility & Compliance Auditor with the functionality of the AI-Powered Media Caption Generator (see previous project:
GPTBot →
), this proposal seeks to deliver a holistic solution. The module will use computer vision, OCR and NLP models to automatically scan pages for ADA/WCAG compliance issues, generate actionable remediation reports, and enhance media accessibility by auto-generating captions and alt texts—improving SEO, user engagement, and overall digital inclusivity.
Project Size: 350 hours (estimate)
Project Difficulty: Intermediate
Project Skills/Prerequisite:
- Expertise in Drupal module development and a strong understanding of Drupal's architecture and APIs.
- Proficiency in PHP and JavaScript, with additional knowledge of Python for AI integration.
- Familiarity with AI frameworks (e.g., Hugging Face Transformers, OpenAI APIs) and computer vision/NLP models.
- Experience with creating administrative dashboards, custom UI for media management, and integrating third-party APIs is beneficial.
Project Technologies: PHP, JavaScript, Python, React, AI Frameworks (e.g., OpenAI, Hugging Face), Computer Vision APIs, NLP Models
Project Description:
Develop a unified Drupal module that leverages AI to both audit site accessibility and generate descriptive captions/alt texts for media. This integrated solution will provide a dynamic dashboard to monitor and remediate accessibility issues while enhancing media content to improve SEO, usability, and overall digital inclusivity.
Proposed Solutions:
- Integrate AI APIs to perform automated accessibility scans using computer vision and NLP models, and to generate context‑aware media captions.
- Develop a responsive remediation dashboard that prioritizes issues, offers one‑click fixes, and supports voice‑activated audit commands.
- Merge features from previous projects such as
GPTBot →
to enhance media management with AI‑powered captioning.
Remaining Tasks:
- Research and select optimal AI models for accessibility analysis and media caption generation (see resources like Hugging Face Transformers and Deque Axe).
- Implement backend integrations with chosen AI providers and build a unified configuration interface using Drupal’s APIs.
- Design and test an administrative UI for audit reporting and caption editing, ensuring seamless compatibility with Drupal core accessibility standards (
Drupal Accessibility Handbook →
).
Project Resources: