Contrib.social

Discussion: Add Dreamstudio Provider into core

Open on Drupal.org →
Created on 19 June 2024, 6 months ago
Updated 8 July 2024, 6 months ago

Problem/Motivation

Currently we have a lot of models that does a lot of text manipulation and some that happens to have some text-to-speech, text-to-image etc.

Dreamstudio is the king of all the different types of text-to-image and image-to-image manipulations. When we add ImageToImage there are a lot of versions of this that is not just "repaint this as an oil canvas" that Dreamstudio offers that fits into this operation type.

Most notibly:
Upscale - take a low resolution version and make it larger.
Creative Upscale - take a really low resolution image and tell the AI what it is and it creatively upscales.
Erase - erase away some specific part of the image, like some guy in the background using masks.
Remove background - make it into a transparent PNG.
Search and Replace - replace with prompts.
Inpaint - mask and paint something at that place.
Outpaint - add data vertically or horizontally to the image using a prompt.
Sketch to image - in comparison to image to image this takes the structures of an image rather then the image so you can use the smallest doodle to create your image.

The API is already mapped out in https://www.drupal.org/project/ai_interpolator_dreamstudio → , so the actual task wouldn't take more then 3-4 hours to fix for an initial version. I will do it anyway, the discussion here is if its in the core or not. I think it should be since it offers unique possibilities.

Its also Stability AI that backs Dreamstudio, so its one of the big providers.

Remaining tasks

Discuss if Dreamstudio should be in core.
If decided yes, make a implementation ticket (and one for image-to-image if it doesn't exist).

✨ Feature request
Status

Fixed

Version

1.0

Component

Discussion

Created by

🇩🇪Germany marcus_johansson

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Comments & Activities

contrib.social Blog FAQ Discussions
Production build 0.71.5 2024