Add OpenAI Vision

Created on 10 November 2023, about 1 year ago
Updated 3 January 2024, 12 months ago

Problem/Motivation

We want to be able to ask GPT about images as well.

Steps to reproduce

Proposed resolution

Remaining tasks

User interface changes

API changes

Data model changes

Feature request
Status

Fixed

Version

1.0

Component

Code

Created by

🇩🇪Germany marcus_johansson

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

  • Issue created by @marcus_johansson
    • ae7ccea8 committed on 1.0.x
      Issue #3400734: Add OpenAI Vision
      
  • 🇩🇪Germany marcus_johansson

    This is fixed on DEV.

    For anyone that wants to test it, you do:

    1. Add an image field on an entity
    2. Add any field that has an OpenAI interpolator
    3. Under the Interpolator choose gpt-4-vision model
    4. Another field pops up that is the Vision Image field, choose the image field you created
    5. Use Advanced prompt and write a prompt - for instance if you fill in a FAQ field it could be "Based on this image, generate 5 questions and answers that might arise about it"
    6. Create an entity and upload an image - the FAQ field is filled out

    The reason it will not be in a new release at the moment, is that the underlying PHP client for OpenAI is not updated for Vision yet, so while its working its giving out error message. Whenever this is fixed it will be released.

  • 🇩🇪Germany marcus_johansson

    I did a new release now and this will be added into it. It is buggy still because the client is outdated. I will see if I can send them a pull request for now.

    I'll leave this issue open since it is still causing issues.

    • ae7ccea8 committed on main
      Issue #3400734: Add OpenAI Vision
      
  • Status changed to Fixed 12 months ago
  • Automatically closed - issue fixed for 2 weeks with no activity.

Production build 0.71.5 2024