Saturday, 5 August 2023

2D to 3D -- CSM

On August 3, 2023 I got free access to CSM (Common Sense Machines).  This is a 2D-to-3D program on Discord:

FIRST 3D Project

Animation of the 3D file


The original image
that I uploaded 



I uploaded the figure image to Discord


The CSM result 
gave me views of what the 3D file would look like
from all angles --
before generating a 3D file


The GLB file was generated in 2 days, and was posted on my CSM Assets page.  However it was free to use:




SECOND 3D Project
Animation of the 3D file


The CSM result 
gave me views of what the 3D file would look like
from all angles --
before generating a 3D file



PREVIOUS 2D to 3D Programs

The AI programs for making  a 3D file have only been around since about December of last year 2022:
  • Leonardo AI3D texture generator  (Shap-E)


**  WebAR  **

I really want to add Augmented Reality 3D images to my prints.  The most direct way seems to be using WebAR as the viewer does not have to download an app on their smartphone (but WebAR does not recognize a "target," yet).



Augmenting 2D prints with 3D images has got to be a lot easier now when AI generates those 3D images.

I fantasized about this back in May 2023:


** STREAMLINED AI AR 3D FANTASY **

What if this whole AR Print fantasy could be streamlined in real time? One would hold their smart phone over the framed 8x8 inch print, and the phone would take a picture of it automatically, like it were reading a QR code. That image would then be sent to the cloud, where Shap-E would automatically generate a 3D image. Then that generated 3D AI image would then be projected over that same print in Augmented Reality, practically in real time, adding a 3D element to a 2D print.

Moreover the smart phone could deliver an older 3D AR image immediately (perhaps generated by the previous viewer), while the new 3D AI AR image was being generated.


One might even use Siri, or another voice command assistant, to influence the 3D image that Shap-E generated.



ARHero.io is going in that direction:






No comments:

Post a Comment

Note: only a member of this blog may post a comment.