Discussion: Add Dreamstudio Provider into core

Open on Drupal.org →

Created on 19 June 2024, 5 months ago

Updated 8 July 2024, 5 months ago

Problem/Motivation

Currently we have a lot of models that does a lot of text manipulation and some that happens to have some text-to-speech, text-to-image etc.

Dreamstudio is the king of all the different types of text-to-image and image-to-image manipulations. When we add ImageToImage there are a lot of versions of this that is not just "repaint this as an oil canvas" that Dreamstudio offers that fits into this operation type.

Most notibly:
Upscale - take a low resolution version and make it larger.
Creative Upscale - take a really low resolution image and tell the AI what it is and it creatively upscales.
Erase - erase away some specific part of the image, like some guy in the background using masks.
Remove background - make it into a transparent PNG.
Search and Replace - replace with prompts.
Inpaint - mask and paint something at that place.
Outpaint - add data vertically or horizontally to the image using a prompt.
Sketch to image - in comparison to image to image this takes the structures of an image rather then the image so you can use the smallest doodle to create your image.

The API is already mapped out in https://www.drupal.org/project/ai_interpolator_dreamstudio → , so the actual task wouldn't take more then 3-4 hours to fix for an initial version. I will do it anyway, the discussion here is if its in the core or not. I think it should be since it offers unique possibilities.

Its also Stability AI that backs Dreamstudio, so its one of the big providers.

Remaining tasks

Discuss if Dreamstudio should be in core.
If decided yes, make a implementation ticket (and one for image-to-image if it doesn't exist).

✨ Feature request

Status

Fixed

Version

1.0

Component

Discussion

Created by

🇩🇪Germany marcus_johansson

Live updates comments and jobs are added and updated live.

Sign in to follow issues

Comments & Activities

Issue created by @marcus_johansson
Comment 5 months ago →
🇧🇪Belgium wouters_f Leuven
Personally I think image to image transitions (dreamstudio) could be a separate module (personal gut feeling)
Comment 5 months ago →
🇩🇪Germany marcus_johansson
Comment 5 months ago →
🇱🇹Lithuania mindaugasd
Assuming project_browser enables to install modules with a few clicks (no composer required), then any service could be not included.

There could be specialized UI which hooks into Drupal update mechanism (I am still to learn how that magic works).
Comment 5 months ago →
🇱🇹Lithuania mindaugasd
Comment 5 months ago →
🇬🇧United Kingdom yautja_cetanu
Yeah I think something like AI_Advanced_Image or AI_Image_Manipulation
Comment 5 months ago →
🇬🇧United Kingdom yautja_cetanu
Status changed to Fixed 5 months ago3:37pm 24 June 2024
Comment 5 months ago →
🇩🇪Germany marcus_johansson
I think the general feeling is not in core.
Comment 5 months ago →
System Message
Automatically closed - issue fixed for 2 weeks with no activity.

contrib.social Blog FAQ Discussions

Production build 0.71.5 2024