Tucson Sculpture Festival 2012

▼

Wednesday, 22 December 2021

AI Art in 2021


In 2021 I continued pushing my drawings through Deep Dream Generator, and then discovered VQGAN+CLIP programs at the end of the year.  Ultimately I combined all of the AI programs to create holographic images.  I also experimented with other text-to-image programs that popped up.

September 7, 2021
A sampling of all the various kinds of AI
altering my drawings in 2021





HOLLY GRIMM

Holly Grimm started off the year giving an online live stream presentation of her AI art for Currents New Media, using her figure drawings for a database:


January 5, 2021

Holly Grimm's online presentation
of her AI art for Currents New Media

Holly Grimm transferred the Tuesday Night Santa Fe drawing group to Zoom, thereby saving it during Covid.  She is also at the forefront of AI art.  I have been following her example, trying to apply the AI tools to my figure drawings.



DEEP DREAM GENERATOR


My most successful formula was to continue using Deep Dream Generator to transfer a style to my pencil drawings, and then blend the AI result with the original, using Layers in Photoshop Elements 2021.

Collaborative Example (with Aggie.io):

A)  Upper Left, the original scanned drawing

B)  Upper Right, that drawing altered in AI by Petalica Paint

C)  Lower Left, that drawing altered in AI by Deep Dream Generator

D)  Lower Right, the two AI results blended using Layers in Photoshop Elements 2021

 

The style transfer process and editing
using Deep Dream Generator
 and blending layers in Photoshop Elements



SUCCESSFUL STYLES:

The most successful styles to transfer to my drawings -- come from the images I created myself below:


January 26, 2021
This image created in Paint 3D
transfers volume style nicely to my thin pencil drawings


I transferred the style of this image
to my figures starting on November 23rd,
including to the figure in the image below


November 23, 2021


The style of this printed image
transfers nicely, to give the idea
of what my other drawings
might look like as a print


Thickening up my thin lines
for half-tone images,
by first transferring the thick lines
of the image posted above


The style of this photograph 
of a red stringy plastic ball
blends really nicely with my thin drawing style


I applied the style of this image
to many of my drawings


I applied this style I made with Paint 3D
to the drawings I made in Texas


I also can generate images online and apply those styles to my drawings, using programs like these:


Blog postings from earlier years about Deep Dream Generator:


PLAYFORM
 
Playform is another online AI platform.  I applied the style of Robert Atkinson's AI creations to my drawings.

Playform AI Experiments
Style transfer on Playform


Playform will also let you "train a model" using just a few images (I used 30), whereas most of the other training programs recommend thousands of images.


EB SYNTH


EBSynth is a style transfer program that works with video, and not just still images (like Deep Dream Generator).  I altered one of my morphing videos with EBSynth, compounding the AI alterations:


My morphing drawing video
altered by EBSynth


VQGAN+CLIP



I also enjoyed using the new VQGAN+CLIP programs in the Colab Notebooks, to make AI art.  I started this about July 6, 2021.


FAKING other artists:

First serious VQGAN+CLIP effort
blending my drawing with that of Egon Schiele


VQGAN+CLIP
turned my drawing into an Egon Schiele
and a Moebius


More VQGAN morphings of my drawings


AI Architecture:

VQGAN+CLIP
my drawing into architecture


August 31, 2021 -- Figure drawings into Architecture
My drawings converted into architecture
using VQGAN+CLIP



PUSHING VQGAN iterations:

I then pushed the VQGAN+CLIP AI process thorough many iterations, starting from the same gesture drawing (colored with AI):
  • First I seeded the VQGAN+CLIP program with the same image, but used various text prompts. 
  • Then I played "telephone" and seeded the VQGAN+CLIP program with the previous image result:
Iterations of VQGAN+CLIP
starting from one of my gesture drawings


Game of Telephone with VQGAN+CLIP,
where the AI image
was seeded with the previous result


VQGAN Sculptures:

My Paint 3D drawings
morphing into styles of other sculptors


More fun with VQGAN+CLIP -- Sculptural
My Paint 3D drawings
morphing into different sculptures



VQGAN with volume:

I further altered some of my VQGAN+CLIP drawings with Deep Dream Generator, to give them more sculptural volume.

VQGAN+CLIP
with Deep Dream Generator
to achieve more sculptural volume


October 26, 2021
AI tweaked to give
sculptural volume


VQGAN Holograms:

The AI sculpture results allowed me to convert them into hologram images:

Hologram Testing
AI into holograms
(the bottom sequence does not work)


Deep Dream Cheeky:

To be completely cheeky:
  • I destroyed a figure drawing (after noodling it to death at a coffee shop)
  • I uploaded it to Deep Dream Generator, and applied their in house "Deep Dream" style to it (top image).  
  • Then I uploaded the result to a VQGAN+CLIP program, and used the text "Deep Dream" prompt to alter the original Deep Dream image (bottom image):

November 2, 2021
Incestuous Deep Dream styling --
first altered in Deep Dream Generator,
then in VQGAN+CLIP using the text prompt "Deep Dream"


Japanese Dalí:

VQGAN+CLIP converted one of my drawings into a Japanese version of a Salvador Dalí's painting "Persistence of Memory":




GLIDE:

Glide is another VQGAN text-to-image program:

I wasn't so impressed with GLIDE



Blog Entries:


VQGAN Programs:


However no matter how well the AI process worked, it always lost all but a trace of my input drawing.  In other words, the results were not really my art.  In fact, there is a danger that everyone's VQGAN+CLIP art looks the same.


StyleGan2 Pretrained Model


My dataset is uploaded on Justin Pinkney's GitHub -- Awesome Pretrained StyleGAN2:


Using ArtBreeder
to turn my drawing into a realistic face


More ArtBreeder advanced variations


DEEP FACE DRAWING


Deep Face Drawing is an online program like Artbreeder, but not nearly as good.

April 6, 2021
Deep Face Drawing
converted my bad drawing into a real face


Monster Mash

MONSTER MASH is a simple online 3D animation software. Google has an entry about Monster Mash on it's AI blog.


Monster Mash
explained on my blog


Monster Mash combined with Augmented Reality:


QR Code
projects the 3D Monster Mash figure pictured
into the real environment





OTHER AI

at

No comments:

Post a Comment

Note: only a member of this blog may post a comment.