2D to 3D -- CSM

On August 3, 2023 I got free access to CSM (Common Sense Machines).  This is a 2D-to-3D program on Discord:

FIRST 3D Project

Midjourney

CSM

Paint 3D

EzGIF

Animation of the 3D file

Download the GLB file (3.65 MB)

June 29, 2023

Midjourney

The original image

that I uploaded 

June 29, 2023

The more realistic figure above

was generated in Midjourney 

from this drawing

• This YouTube gives the instructions:  CSM Image-to-3D Discord Instructions

I uploaded the figure image to Discord

The CSM result 

gave me views of what the 3D file would look like

from all angles --

before generating a 3D file

The GLB file was generated in 2 days, and was posted on my CSM Assets page.  However it was free to use:

I can see the 3D result

and inputs from my CSM  page

SECOND 3D Project

Midjourney

CSM

Paint 3D

EzGIF

Animation of the 3D file

Download the GLB file  (3.98 MB)

July 6, 2023

Midjourney

The original image

that I uploaded 

July 6, 2023

The more realistic figure above

was generated in Midjourney 

from this drawing

The CSM result 

gave me views of what the 3D file would look like

from all angles --

before generating a 3D file

I can see the 3D result

and inputs from my CSM  page

***

I also generated an AI animation from the same basic Midjourney image using PIKA LABS:

July 6, 2023

Midjourney

PIKA LABS

EzGIF

AI animation of the same basic figure

made in PIKA LABS

3D PRINT

Tim printed the CSM figure for me on August 5th at Quelab:

2D-to-3D to Physical Print --

made from the AI generated 3D file

by CSM

Tim used PrusaSlicer-2.6.0

PrusaSlicer-2.6.0

Printed on an Ender 3D printer

• There is a camera on the 3D printer to see the progress (when on the same wifi)

The final print

PREVIOUS 2D to 3D Programs

The AI programs for making  a 3D file have only been around since about December of last year 2022:

• Latent Labs -- text to 3D in Discord  (May 25, 2023)
• Shap-E  (Shap-E)
• Point-E  (Text-to-3D)

• Leonardo AI, 3D texture generator  (Shap-E)

**  WebAR  **

I really want to add Augmented Reality 3D images to my prints.  The most direct way seems to be using WebAR as the viewer does not have to download an app on their smartphone (but WebAR does not recognize a "target," yet).

• WebAR with Linocut Prints
• Hologram and AR -- 2022
• Shap-E

3D WebAR

Augmenting 2D prints with 3D images has got to be a lot easier now when AI generates those 3D images.

I fantasized about this back in May 2023:

** STREAMLINED AI AR 3D FANTASY **

What if this whole AR Print fantasy could be streamlined in real time? One would hold their smart phone over the framed 8x8 inch print, and the phone would take a picture of it automatically, like it were reading a QR code. That image would then be sent to the cloud, where Shap-E would automatically generate a 3D image. Then that generated 3D AI image would then be projected over that same print in Augmented Reality, practically in real time, adding a 3D element to a 2D print.

Moreover the smart phone could deliver an older 3D AR image immediately (perhaps generated by the previous viewer), while the new 3D AI AR image was being generated.

One might even use Siri, or another voice command assistant, to influence the 3D image that Shap-E generated.

ARHero.io is going in that direction:

ARHero

• YouTube: AR Hero - Functional AR made easy. Pt 1
• YouTube: AR Hero - Functional AR made easy. Pt 2