Store the output of AI tools

Created on 18 November 2024, about 1 month ago

Currently we only store in the evals the input and outputs of the LLMs but the Agents talk to "Tools", bits of code or functions on the Drupal site that can return messages. Some of these messages are quite advanced (Such as the output of Search or a RAG search). Some are simpler (Adding a taxonomy term with id 1 and label "cheese").

We should store these in the evaluations too. They are passed into the assistant message so will usually be in that history but not necessarily always especially in the Agent history.

📌 Task
Status

Active

Version

1.0

Component

Code

Created by

🇬🇧United Kingdom yautja_cetanu

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Production build 0.71.5 2024