The definition of the Drupal\ai_agents\Plugin\AiFunctionCall\Vision functioon call allows the provision of a prompt string, but the code in the execute() method immediately overrides it:
// Collect the context values.
$prompt = $this->getContextValue('prompt');
$image_id = $this->getContextValue('image_id');
$default = $this->aiProviderManager->getDefaultProviderForOperationType('chat_with_image_vision');
$provider = $this->aiProviderManager->createInstance($default['provider_id']);
$prompt = "Could you describe this image?\n";
Either the prompt in the definition should be removed and the hardcoded prompt relied on, or else the prompt from the definition should be used and only overwritten if it is not set.
Active
1.1
Code
The plugin also assumes that the site is configured with a provider with 'chat_with_image_vision' capabilities: should we fix this at the same time?