Skip to content

Latest commit

 

History

History
129 lines (68 loc) · 7.83 KB

the_next_generation_img2img_and_controlnet.md

File metadata and controls

129 lines (68 loc) · 7.83 KB

Combining One Button Prompt with IMG2IMG and ControlNET

Since One Button Prompt does nothing more than generate a prompt, means we can combine it with most other tools and extensions available. In this document, I'd like to show you some possibilities of using it with IMG2IMG functionality and ControlNET. Hopefully this will lead to additional inspiration and new ways to approach these tools.

In these examples, I am all using the deliberate model.

I've set the Sampling method to "DPM++ SDE Karras", Sampling steps to "30" and used the standard CFG Scale "7",

Generating skulls with IMG2IMG

In this example, I'm using a picture of a skull found on the internet. I'm using this one, since it has loads of background noise, which can create interesting stuff.

I load up this image in IMG2IMG. I kept the Denoise strength at 0.75 for this example.

In One Button Prompt, I use the following settings:

As a "Subject Type" I select "object", because we are generating a skull, and a skull is an object. At least, from One Button Prompt's perspective.

For "Artists" I select "all". I want to get surprised, so I leave this to all.

As "Type of image" I select "portrait", so that it will always default to a portrait image. Since we want a close up of the skull, that matches the picture.

As the "Subject override" I write down skull, so it will start generating skulls. If you want, you can change this to something else, or leave blank for interesting results.

image

Example output images:

portrait,close up of a Baroque skull, designed by Lamborghini, floating in space, Golden ratio, plain deep yellow background, at Twilight, Ultrarealistic, Golden ratio

portrait,close up of a Authentic Chinoiserie skull, dark orange and Orange background, Berlin Secession, Rembrandt lighting, Desaturated, made of Concrete, masterpiece

art by Gail Simone, portrait,close up of a Visually Stimulating Visually Stimulating skull, Sharp details, [garden|jungle], at Sunrise, telephoto lens

art by Kim Keever, portrait,close up of a Enthralling Tang Dynasty skull, Happy

Generating Stormtrooper helmet based images with ControlNET

In this case, we are going back to using TXT2IMG. Please note, that most of these images came out amazing. You can use this trick to win almost anything on \r\sdbattles\

I've configured ControlNET to use this Stormtrooper helmet:

I've set it to use the "Depth" ControlNET model. In this case I'm using "depth_midas", this is what it defaulted to.

I've set "Ending Control Step" to 0,75, meaning that ControlNET will stop doing it's thing 75% through all steps.

I'm using the setting "My prompt is more important"

image

I've set up One Button Prompt to the following settings:

As a "Subject Type" I select "object", however, you could try all to get even wierder results.

For "Artists" I select "all". I want to get surprised, so I leave this to all.

As "Type of image" I select "all", more surprises in store for us.

image

Example images:

art by Kazuo Oga, Golden ratio, Obscene hypercar, concept art, from inside of a Elite Dalaran, Summer, Grim, Auroracore, Sun Rays, Kodak Ektar

Cycles render, Messy Ecuadorian Volkswagen of Guilt, concept art, Funk Art, bloom, art by Shepard Fairey

art by Alejandro Burdisio, (art by Alex Schomburg:1.0), voxel art, Alluring Entrancing Castle of Haste, smooth, Folded street, Lens Flare

art by Vanessa Bell, (art by Jhonen Vasquez:1.0), grand Octane render, Unpredictable Taiwanese Snow plow, intricate details, Smug, Reflected light, matte, Bright design

Reverse inpainting of Pedro Pascal

One Button prompt can also usefull in inpainting tasks. In this example, I'm going to do what I like to call a "reverse inpaint". This time on the face of Pedro Pascal. Note that this trick will also work on your own face.

First I load up the foto of Pedro Pascal in the Inpaint tab, and then I paint over his face. It doesn't have to be perfect.

Make sure to turn on "Inpaint not masked" so that we replace everything but his face.

I've set padding to "64" and mask blur to "8". Denoising strength is set to "0.7".

image

I then load up an inpainting model. Because we are using a photo, I am using the realisticVision inpainting model for this example.

For One Button Prompt, I set the following settings:

As a "Subject Type" I select "humanoid"

For "Artists" I select "portrait". This way we get artists to create portraits, which is what we want in this case.

As "Type of image" I select "all", more surprises in store for us. We could use Portrait here as well.

Example results:

Delicate diane lane, Exploring new places, Platinum hair styled as long straight, Glittering Persian cat face paint, Smooth No makeup, Foggy, split diopter, Ultra Detailed, Embarrassing, L USM, Golden ratio, inticrate details, hyperdetailed

art by Roy Lichtenstein, Redshift render, Fallacious, Vengeful Noble well-endowed Male Actor, Heavenly Blonde hair, Thunderstorm, Lonely, MinecraftCore

art by Rebeca Saray, Infected Inventive Dragonkin, �, wearing Striped Satin Pleated skirt and tucked-in blouse, Tang Dynasty Earrings, plain Gold background, horizon-centered, Neo-Fauvism, Direct light, masterpiece

Jagged stocky Indonesian Father, Exploring new places, Layered cut hair, Pixiecore, 800mm lens, Warm Colors, 8K

Thank you

Hope to have give you some inspiration on where you could use One Button Prompt as well, in unexpected ways. Your creativity is what unlocks it's power.