%20(1).gif)
I animated my AI drawing
after SAM 3 segmented it
However while Meta's SAM 3 was amazing for turning some 2D people into 3D (as GLB files), there was so much more that we could not do. I would like to turn individual shapes inside my figures into 3D parts, for instance, and then change the orientation of those moving 3D individual parts. PartCrafter does that, segmenting into 3D files, with parts that I can alter in BLENDER.
And META offered 4 different segment features:
I used the "Create video cutouts" to segment out the animals from a previous video, and then give them a glowing contour:
I decided to try the video segmentation again with one of my drawings that I had animated, adding moving parts, cylinders and spheres:
I would have liked to move around the individual cylinders in SAM 3, before adding the colored outlines, but the program would not let me do this. However I could always move the cylinders in BLENDER with the original BLENDER file:
I uploaded an AI coffee shop scene that I generated in KREA, and used the "Create image cutouts" to segment the figures from the scene and gave them a green glow: 
I uploaded the previous coffee shop scene from above to "Create 3D scenes" and generated a 3D splat model, and a video with Pulse Effects:
However I could not do anything with the GLB file that I exported from BLENDER, as it would not open in Paint 3D or the AR <model-viewer>. So I went a different route:
CREATE VIDEO CUTOUTS
Adding the glowing contours
after I segmented out the animals in the video
I recycled my Midjourney AI video
to make it glow
SPINNING
After first turning this GIF file into an MP4, I uploaded the video into SAM 3 and segmented the moving cylinders:
I added colorful outlines to the moving cylinders
SAM 3 separated the moving cylinders
and added the colorful outlines
CREATE IMAGE CUTOUTS
SAM 3 picked out and segmented all the people
After SAM 3 picked out the figures,
it added glowing green contours
PEN DRAWING
I wondered how well SAM 3 would break down one of my drawings into individual shapes, so I choose a pen drawing thinking that would be easiest:
I wanted SAM 3 to break my drawing
down into individual shapes
The process was not so straight forward. SAM 3 did not always choose clean shapes, for instance, and I had to continue editing the segmentation to get something more useable.
I could not get rid of the jaggedness
in some of the shapes
Perhaps I can get Gemini 3 to write a program to do something with the individual shapes. I asked Google's Nano Banana Pro to rearrange the pieces:
CREATE 3D SCENES
The program separated the figures nicely, and then made a PLY file of the scene:
- Download: Coffee_scene_ply.PLY (2.72 MB)
However I could not do anything with the GLB file that I exported from BLENDER, as it would not open in Paint 3D or the AR <model-viewer>. So I went a different route:
The PLY file viewed in superspl.at
I converted that PLY file into a SPLAT file in superspl.at, and then converted that SPLAT file into a GLB. Then I had to upload and export that file in BLENDER to get a GLB that Paint 3D would recognize:
Download: Coffee_scene.GLB (982.67 KB)
The GLB file looks weird as threads,
apparently an artifact from the original PLY/SPALT files
SAM 3 also let me add effects and download a video of the 3D file (after which I could download the 3D file):
Adding effects and making a video
Pulse Wave effect in the video
- I could not upload a gaussian file to Marble Worlds to make a 3D scene (though it would accept an image or a video)
CREATE 3D BODIES
SAM 3 generated 3D files armed with bones
SAM 3 separated the four individual figures, and then generated separate 3D files of each figure -- in GLB format with BONES. Each GLB file was about 2.5 MB:
.gif)
Animations of each of the four 3D figures from the coffee scene
Download the big main figure with bones:
Coffee_scene_b.GLB (2.51 MB)
- UGLY ANIMATIONS -
I quickly experimented with the 3D figures and quickly made bad animations in BLENDER. This is more proof-of-concept than anything worth looking at.
I uploaded the the main 3D figure "Coffee_scene_b.glb" to ChatGPT and asked it to animate the figure for me. :
I refined my question to ChatGPT
and it generated "Blender Python script"
to animate my figure in BLENDER
Bad animation from one of the SAM 3 people in 3D,
made by the code generated in ChatGPT
executed in BLENDER
I uploaded all four of the figures generated in SAM 3 to BLENDER, and was able to make a bad animation, though I barely knew what I was doing:
I uploaded all four of the 3D figures generated by SAM 3,
and made a bad animation in BLENDER
No comments:
Post a Comment
Note: only a member of this blog may post a comment.