Contrib.social

Potential errors in vision model

Open on Drupal.org →
Created on 16 January 2025, 3 months ago

Cross posting from https://www.drupal.org/project/ai_image_alt_text/issues/3500084 💬 What provider should be configured to make this work? Active

When setting up AI Image Alt Text at /config/ai/ai_image_alt_text the field for AI provider/model has a default value that reads, "Use Default Image Vision Model."

On the AI Module settings page, where you set default models, config/ai/settings, there is nothing labeled Image Vision Model.

I tried a Chat with Image Vision model and that does appear in the dropdown list but that generates the following error in the logs.

PHP Error:
Error: Call to a member function chat() on null in Drupal\ai_image_alt_text\Controller\GenerateAltText->generate() (line 135 of /app/web/modules/contrib/ai_image_alt_text/src/Controller/GenerateAltText.php).

This leads me to believe the chat model is not what this module expects.

Does the module only work with some AI providers? I was trying Azure OpenAI ChatGPT-4o.

Thank you

🐛 Bug report
Status

Active

Version

1.0

Component

Code

Created by

🇩🇪Germany marcus_johansson

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

  • Issue created by @marcus_johansson
  • Comment 3 months ago →
    🇺🇸United States theMusician

    I also get errors when trying to use the core AI module content suggestions, config/ai/suggestions.

    This is what is returned when trying to analyze the page title for an improved title:

    Error: Call to a member function setChatSystemRole() on null in Drupal\ai_content_suggestions\AiContentSuggestionsPluginBase->sendChat() (line 310 of /app/web/modules/contrib/ai/modules/ai_content_suggestions/src/AiContentSuggestionsPluginBase.php)

    and this is from trying to analyze the body content for readability:
    Error: Call to a member function setChatSystemRole() on null in Drupal\ai_content_suggestions\AiContentSuggestionsPluginBase->sendChat() (line 310 of /app/web/modules/contrib/ai/modules/ai_content_suggestions/src/AiContentSuggestionsPluginBase.php)

  • Comment 3 months ago →
    🇺🇸United States theMusician

    After upgrading to AI 1.0.3 this is now working on a local install.

  • Comment 3 months ago →
    🇩🇪Germany marcus_johansson

    Can this be closed, since it seems to work?

  • Comment 3 months ago →
    🇺🇸United States theMusician

    I tried it again today before closing this and it seems the Azure Provider is again falling down. The general help message that appears states,

    Warning message
    We could not create an Alt Text, please try again later.

    When attempting to generate alt text I get the original error in the logs:

    Error: Call to a member function chat() on null in Drupal\ai_image_alt_text\Controller\GenerateAltText->generate() (line 135 of /app/web/modules/contrib/ai_image_alt_text/src/Controller/GenerateAltText.php).

    Backtrace:

    #0 [internal function]: Drupal\ai_image_alt_text\Controller\GenerateAltText->generate(Object(Drupal\file\Entity\File), 'en')
#1 /app/web/core/lib/Drupal/Core/EventSubscriber/EarlyRenderingControllerWrapperSubscriber.php(123): call_user_func_array(Array, Array)
#2 /app/web/core/lib/Drupal/Core/Render/Renderer.php(638): Drupal\Core\EventSubscriber\EarlyRenderingControllerWrapperSubscriber->Drupal\Core\EventSubscriber\{closure}()
#3 /app/web/core/lib/Drupal/Core/EventSubscriber/EarlyRenderingControllerWrapperSubscriber.php(124): Drupal\Core\Render\Renderer->executeInRenderContext(Object(Drupal\Core\Render\RenderContext), Object(Closure))
#4 /app/web/core/lib/Drupal/Core/EventSubscriber/EarlyRenderingControllerWrapperSubscriber.php(97): Drupal\Core\EventSubscriber\EarlyRenderingControllerWrapperSubscriber->wrapControllerExecutionInRenderContext(Array, Array)
#5 /app/vendor/symfony/http-kernel/HttpKernel.php(181): Drupal\Core\EventSubscriber\EarlyRenderingControllerWrapperSubscriber->Drupal\Core\EventSubscriber\{closure}()
#6 /app/vendor/symfony/http-kernel/HttpKernel.php(76): Symfony\Component\HttpKernel\HttpKernel->handleRaw(Object(Symfony\Component\HttpFoundation\Request), 1)
#7 /app/web/core/lib/Drupal/Core/StackMiddleware/Session.php(53): Symfony\Component\HttpKernel\HttpKernel->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#8 /app/web/core/lib/Drupal/Core/StackMiddleware/KernelPreHandle.php(48): Drupal\Core\StackMiddleware\Session->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#9 /app/web/core/lib/Drupal/Core/StackMiddleware/ContentLength.php(28): Drupal\Core\StackMiddleware\KernelPreHandle->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#10 /app/web/core/modules/big_pipe/src/StackMiddleware/ContentLength.php(32): Drupal\Core\StackMiddleware\ContentLength->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#11 /app/web/core/modules/page_cache/src/StackMiddleware/PageCache.php(106): Drupal\big_pipe\StackMiddleware\ContentLength->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#12 /app/web/core/modules/page_cache/src/StackMiddleware/PageCache.php(85): Drupal\page_cache\StackMiddleware\PageCache->pass(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#13 /app/web/core/lib/Drupal/Core/StackMiddleware/ReverseProxyMiddleware.php(48): Drupal\page_cache\StackMiddleware\PageCache->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#14 /app/web/core/lib/Drupal/Core/StackMiddleware/NegotiationMiddleware.php(51): Drupal\Core\StackMiddleware\ReverseProxyMiddleware->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#15 /app/web/core/lib/Drupal/Core/StackMiddleware/AjaxPageState.php(36): Drupal\Core\StackMiddleware\NegotiationMiddleware->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#16 /app/web/core/lib/Drupal/Core/StackMiddleware/StackedHttpKernel.php(51): Drupal\Core\StackMiddleware\AjaxPageState->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#17 /app/web/core/lib/Drupal/Core/DrupalKernel.php(741): Drupal\Core\StackMiddleware\StackedHttpKernel->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#18 /app/web/index.php(19): Drupal\Core\DrupalKernel->handle(Object(Symfony\Component\HttpFoundation\Request))
#19 {main}

    Swapping to another provider and it works.

  • Comment about 2 months ago →
    🇧🇷Brazil ricardo santos

    ricardo santos → made their first commit to this issue’s fork.

  • Comment about 2 months ago →
    🇺🇸United States shasha821110

    same issue happen in Azure OpenAI ChatGPT-4o.
    Switch to OpenAI works good.

  • Comment 24 days ago →
    🇩🇪Germany Antonín Slejška Hannover

    I experience the same problem with "Azure - OpenAI GPT-4o Mini" model. (It does work with the Gemini provider.)

    The problem is, that the method isUsable in the plugin AzureProvider returns FALSE. It returns FALSE, because $operation_type is NULL. The variable is null because it is called without parameters, see: https://git.drupalcode.org/project/ai/-/blob/1.0.5/src/AiProviderPluginM...

  • Comment 24 days ago →
    🇩🇪Germany Antonín Slejška Hannover

    The following commit solves the issue described in the comment #8:
    https://git.drupalcode.org/project/ai_provider_azure/-/commit/052496c055...

    When I install "drupal/ai_provider_azure:1.0.x-dev@dev", then the provider works for me. It would be nice to create a new tag.

  • Comment 21 days ago →
    🇺🇸United States theMusician

    Thanks for finding the issue. Your fix works on my end to get past the noted error. I think in the Azure AI portal I still need to work on allowing my dev box access to the API but it does now make the call.

  • Comment 16 days ago →
    🇺🇸United States shasha821110

    hmm, I am still get the error like the following in drupal/ai_provider_azure:1.0.x-dev@dev

    #0 /var/www/html/vendor/openai-php/client/src/Responses/Chat/CreateResponse.php(48): array_map(Object(Closure), NULL)
#1 /var/www/html/vendor/openai-php/client/src/Resources/Chat.php(35): OpenAI\Responses\Chat\CreateResponse::from(Array, Object(OpenAI\Responses\Meta\MetaInformation))
#2 /var/www/html/web/modules/contrib/ai_provider_azure/src/Plugin/AiProvider/AzureProvider.php(346): OpenAI\Resources\Chat->create(Array)
#3 [internal function]: Drupal\ai_provider_azure\Plugin\AiProvider\AzureProvider->chat(Object(Drupal\ai\OperationType\Chat\ChatInput), 'openai-gpt-4o', Array)
#4 /var/www/html/web/modules/contrib/ai/src/Plugin/ProviderProxy.php(193): ReflectionMethod->invokeArgs(Object(Drupal\ai_provider_azure\Plugin\AiProvider\AzureProvider), Array)
#5 /var/www/html/web/modules/contrib/ai/src/Plugin/ProviderProxy.php(103): Drupal\ai\Plugin\ProviderProxy->wrapperCall(Object(ReflectionMethod), Array)
#6 /var/www/html/web/modules/contrib/ai_image_alt_text/src/Controller/GenerateAltText.php(139): Drupal\ai\Plugin\ProviderProxy->__call('chat', Array)
#7 [internal function]: Drupal\ai_image_alt_text\Controller\GenerateAltText->generate(Object(Drupal\file\Entity\File), 'en')
#8 /var/www/html/web/core/lib/Drupal/Core/EventSubscriber/EarlyRenderingControllerWrapperSubscriber.php(123): call_user_func_array(Array, Array)
#9 /var/www/html/web/core/lib/Drupal/Core/Render/Renderer.php(638): Drupal\Core\EventSubscriber\EarlyRenderingControllerWrapperSubscriber->Drupal\Core\EventSubscriber\{closure}()
#10 /var/www/html/web/core/lib/Drupal/Core/EventSubscriber/EarlyRenderingControllerWrapperSubscriber.php(121): Drupal\Core\Render\Renderer->executeInRenderContext(Object(Drupal\Core\Render\RenderContext), Object(Closure))
#11 /var/www/html/web/core/lib/Drupal/Core/EventSubscriber/EarlyRenderingControllerWrapperSubscriber.php(97): Drupal\Core\EventSubscriber\EarlyRenderingControllerWrapperSubscriber->wrapControllerExecutionInRenderContext(Array, Array)
#12 /var/www/html/vendor/symfony/http-kernel/HttpKernel.php(181): Drupal\Core\EventSubscriber\EarlyRenderingControllerWrapperSubscriber->Drupal\Core\EventSubscriber\{closure}()
#13 /var/www/html/vendor/symfony/http-kernel/HttpKernel.php(76): Symfony\Component\HttpKernel\HttpKernel->handleRaw(Object(Symfony\Component\HttpFoundation\Request), 1)
#14 /var/www/html/web/core/lib/Drupal/Core/StackMiddleware/Session.php(53): Symfony\Component\HttpKernel\HttpKernel->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#15 /var/www/html/web/core/lib/Drupal/Core/StackMiddleware/KernelPreHandle.php(48): Drupal\Core\StackMiddleware\Session->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#16 /var/www/html/web/core/lib/Drupal/Core/StackMiddleware/ContentLength.php(28): Drupal\Core\StackMiddleware\KernelPreHandle->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#17 /var/www/html/web/core/modules/big_pipe/src/StackMiddleware/ContentLength.php(32): Drupal\Core\StackMiddleware\ContentLength->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#18 /var/www/html/web/core/modules/page_cache/src/StackMiddleware/PageCache.php(106): Drupal\big_pipe\StackMiddleware\ContentLength->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#19 /var/www/html/web/core/modules/page_cache/src/StackMiddleware/PageCache.php(85): Drupal\page_cache\StackMiddleware\PageCache->pass(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#20 /var/www/html/web/core/modules/ban/src/BanMiddleware.php(50): Drupal\page_cache\StackMiddleware\PageCache->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#21 /var/www/html/web/modules/contrib/shield/src/ShieldMiddleware.php(263): Drupal\ban\BanMiddleware->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#22 /var/www/html/web/modules/contrib/shield/src/ShieldMiddleware.php(130): Drupal\shield\ShieldMiddleware->bypass(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#23 /var/www/html/web/core/lib/Drupal/Core/StackMiddleware/ReverseProxyMiddleware.php(48): Drupal\shield\ShieldMiddleware->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#24 /var/www/html/web/core/lib/Drupal/Core/StackMiddleware/NegotiationMiddleware.php(51): Drupal\Core\StackMiddleware\ReverseProxyMiddleware->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#25 /var/www/html/web/core/lib/Drupal/Core/StackMiddleware/AjaxPageState.php(36): Drupal\Core\StackMiddleware\NegotiationMiddleware->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#26 /var/www/html/web/modules/contrib/remove_http_headers/src/StackMiddleware/RemoveHttpHeadersMiddleware.php(49): Drupal\Core\StackMiddleware\AjaxPageState->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#27 /var/www/html/web/core/lib/Drupal/Core/StackMiddleware/StackedHttpKernel.php(51): Drupal\remove_http_headers\StackMiddleware\RemoveHttpHeadersMiddleware->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#28 /var/www/html/web/core/lib/Drupal/Core/DrupalKernel.php(741): Drupal\Core\StackMiddleware\StackedHttpKernel->handle(Object(Symfony\Component\HttpFoundation\Request), 1, true)
#29 /var/www/html/web/index.php(19): Drupal\Core\DrupalKernel->handle(Object(Symfony\Component\HttpFoundation\Request))
#30 {main}
contrib.social Blog FAQ Discussions
Production build 0.71.5 2024