Contrib.social

Provide a framework for testing with real providers

Open on Drupal.org →
Created on 13 December 2024, about 2 months ago

We need a mechanism for running tests against real LLMs to test that the integrations behave as expected. As LLMs are not deterministic and costly, this should be separated from normal tests. Initially these would be manually run locally.

As part of this, we want to be able to use these tests for trialling changes to prompts etc via a UI. The actual UI will be a separate project, as we won't want it or it's dependencies installed on normal sites.

📌 Task
Status

Needs work

Version

1.0

Component

Miscellaneous

Created by

🇬🇧United Kingdom andrewbelcher

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

contrib.social Blog FAQ Discussions
Production build 0.71.5 2024