Enhance Evaluation Entity View with Processed Results and Summaries

Problem/Motivation

Currently, the Evaluation entity’s View in the Drupal AI Evaluations module displays raw data and metadata without additional processing. This makes it difficult for users to understand the evaluation’s outcome at a glance, as they have to manually sift through the raw information to discern key findings.

The View should instead provide a clear and concise summary of the evaluation, including the reasoning behind the thumbs up or thumbs down decision. By leveraging the recorded messages and the power of an LLM (Large Language Model), this data can be processed into a user-friendly format.

Proposed resolution

The View must display the following:

• A clear result of the evaluation (e.g., “Thumbs Up” or “Thumbs Down”).
• Reasoning behind the decision, derived from recorded messages and metadata.

Remaining tasks

Utilize an LLM to:

• Summarize all recorded messages relevant to the evaluation.
• Highlight important findings in a structured format.
• Format the summary with headings, bullet points, or other visual aids for better readability.

User interface changes

• Replace the current raw data display with the LLM-generated summary and processed results.
• Provide a toggle option to view raw data for advanced users, if needed.