Add function calling and possible 1.1.x release

Created on 12 June 2025, about 2 months ago

Problem/Motivation

We will release tools/function calling and structured output in the 1.1.x release and all new agents will use this, so its critical to have support for this for amazee.ai provider to be usable.

The changes will need to be minor, since LiteLLM/OpenAI infrastructure already takes care of it. There will soon be a release of the LiteLLM in version 1.1.0 and it should be enough to pin this and add some extra settings.

Proposed resolution

  • Pin to version 1.1.0 of drupal/ai and drupal/ai_provider_litellm
  • In the provider file under getDefaultModels, there are two new default model types that should be added - chat_with_tools and chat_with_structured_response - this could either be pinned to chat_with_complex_json model or if you add new ones.
  • Create update hooks that update these two - see here for example of this
  • Release it under 1.1.x branch?

Remaining tasks

User interface changes

API changes

Data model changes

Feature request
Status

Active

Version

1.0

Component

Code

Created by

🇩🇪Germany marcus_johansson

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

Production build 0.71.5 2024