Automatic 1111 -- Stable Diffusion

Automatic 1111-Stable Diffusion allows me to upload a figure drawing on my own computer, and generate an AI image from that image -- and it works quickly, way faster than Midjourney:

August 15, 2023

Generating AI Art from an image

on a local computer --

My drawing (top),

the Automatic 1111-Stable Diffusion AI version (bottom)

We have been using Automatic 1111 at Quelab after Grant lent his powerful computer (with a powerful RTX video card) to the hackerspace on August 2nd.  Within the week Adam had installed Stable Diffusion (Automatic 1111) and various models from Civitai to work from.  He also set up remote access so that I could generate AI Art from my home, using the Quelab computer.  Amazing!

August 15, 2023

One of the better figures

generated in Automatic 1111-Stable Diffusion

based on my figure drawing

We even generated an AI Print from only text, using Automatic 1111, and printed it in the Santa Fe Railyard:

AI PRINT

This image was generated entirely in Automatic 1111

and then laser engraved into linoleum

to be printed on a Tortilla Press

during the PRINTERS PLANET Festival in Santa Fe

Just for fun, I used AI to animate one of the Automatic 1111 art generations, using PIKA LABS in Discord:

Automatic 1111

PIKA LABS

CIVITAI MODELS

In order to generate images with Automatic 1111-Stable Diffusion one needs to use AI "models."  Adam downloaded the most popular models from CIVITAI -- and "placed the model inside the "models/Stable-diffusion" directory of your AUTOMATIC1111 Web UI instance."

I also uploaded a "model" based on my drawings that was created online in Open Art (using PhotoBooth):

model_20221213233657.ckpt  (2 GB)

DEFORUM

Within Automatic 1111 is a tab for DEFORUM, which is a program for making AI video.  

I uploaded four of my drawings to Deforum and generated the AI art video below:

August 14, 2023

Deforum AI Video of Krrrl Drawings

NOTE:  I generated the Deforum video from the model based on my drawings

We found out how to use "image prompts" in Deforum, by opening the "Guided Images" carrot, and pasting in the URLs of the key images we wanted to insert:

Open the "Guided Images" tab by checking the carrot.  Then replace the images, by pasting the URLs of your images into the box below:

 August 14, 2023

Open the "Guided Images" box 

by checking the carrot,

and paste your image URLs into the code

ALSO, change the text prompts in the code box below to your liking (example: "figure drawing of a woman):

August 14, 2023

Using "Image Prompts"

in Deforum

Other DEFORUM videos

Rope Scupture -- Part 1

I generated another video

based on AI versions of my drawings

using DEFORUM

Another example: Adam's Deforum AI video:

YouTube:"screen printing with stable diffusion and deforum"

LORA Models

Automatic 1111 even allows you to train your own "models," which makes it even more powerful.

However LoRAs (Low Rank Adaption for fast text-to-image diffusion fine tuning) can train with 30 images, rather than a data base of infinite images.

• For a simplified explanation here is a guide in one image panel (from Reddit).

 USING LORAs

To use a LORA in Automatic 1111 is a little different from just choosing a regular model:

• To install LoRA models in AUTOMATIC1111 webui, put the model files in the following folder:

stable-diffusion-webui/models/Lora

• To use a LoRA model, put the following phrase in the prompt.<lora:filename:multiplier>

• filename is the file name of the LoRA model, excluding the extension (.pt, .bin, etc).

• multiplier is the weight applied to the LoRA model. The default is 1. Setting it to 0 disables the model.

• How can you be sure the filename is correct? Instead of writing this phrase, you should click on the model button.

• Also:  How to train LORAs using Kohya GUI

---

• YouTube: ComfyUI - Getting Started : Episode 1 - Better than AUTO1111 for Stable Diffusion AI Art generation

• This Peter Gabriel music video is a good example of a state-of-the-art AI video