Integrate local AI models with Drupal's AI module using Docker Model Runner. Test & build AI solutions without API costs, perfect for local development & experimentation.

The Docker Model Runner Provider module is your gateway to leveraging AI models directly within your Drupal projects, all from your local machine. Forget costly external APIs during development; this module connects Drupal's AI capabilities to Docker Model Runner, creating a seamless, cost-free environment for experimentation and rapid prototyping.

It provides a local, efficient, and budget-friendly way to integrate AI chat functionalities into Drupal. This empowers developers to build and test AI features rapidly, turning your local setup into a powerful AI sandbox.

Features

Local AI for Free: Develop AI features without external API costs.
Seamless Chat Integration: Connects directly to Drupal AI's ChatInterface.
Rapid Experimentation: Test different models and prompts quickly.
Developer Friendly: Aligns with Docker's "Models" feature, bringing AI control to your machine.

Requirements

Beyond Drupal core, you'll need:

Drupal AI module
Docker Engine or Docker Desktop: (Windows 4.21+ / macOS 4.20+).
Docker Desktop for Mac with Apple Silicon or Windows with NVIDIA GPUs.
Docker Model Runner (Beta): Installed and running.
AI Models: Downloaded locally via docker model pull.

Post-Installation

Once enabled, configuring is a breeze:

Verify Docker Model Runner: Make sure docker model status shows it's running.
Pull Your Models: Download models (e.g., docker model pull ai/qwen2.5:0.5B-F16) from the Docker Hub Generative AI Catalog.
Configure in Drupal AI: Go to admin/config/ai, add a new Docker Model Runner Provider, and then create an Assistant linked to your local model.

Community Documentation

For Docker Model Runner setup, refer to the official Docker AI documentation.

Docker Model Runner Provider

Issues

Model names in Docker has changedActiveCode Created about 1 month ago

Model names in Docker has changed
Active
Code
Created about 1 month ago