Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

I tried Meta’s new SAM 3D tool. It’s impressive. In about ten seconds it segmented the bed from my photo and turned it into a full 3D object. The quality surprised me. Only catch right now is it exports as PLY. I’d love USDZ so I can drop it... show more

Justin Ryan

11,978 subscribers

52,050 Aufrufe • vor 8 Monaten •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

I turned my living room into a full-on Blockbuster with Apple Vision Pro! Posters. Shelves. Trailers. The works. The app is called ReelRoom and I love it! If you miss the Friday night video store vibe, this brings it all back.

I turned my living room into a full-on Blockbuster with Apple Vision Pro! Posters. Shelves. Trailers. The works. The app is called ReelRoom and I love it! If you miss the Friday night video store vibe, this brings it all back.

Justin Ryan ᯅ

52,920 Aufrufe • vor 1 Jahr

AI + AR is going to change everything! I turned my photo into a 3D bobblehead in under 5 minutes using ChatGPT and Tripo3D. Dropped it into my space with Vision Pro. It’s wild. No wonder Apple and Meta are shifting some of their XR people onto AI teams.

AI + AR is going to change everything! I turned my photo into a 3D bobblehead in under 5 minutes using ChatGPT and Tripo3D. Dropped it into my space with Vision Pro. It’s wild. No wonder Apple and Meta are shifting some of their XR people onto AI teams.

Justin Ryan ᯅ

12,232 Aufrufe • vor 1 Jahr

oh may.. 3D Gaussian Splat is so crazy now last time we need weeks to turn a room into a 3D model.. now with AI 3DGS, you do it in seconds… even zoom into the text and looks perfect give it like 6 months… you can turn a whole city into a full detailed 3D model

oh may.. 3D Gaussian Splat is so crazy now last time we need weeks to turn a room into a 3D model.. now with AI 3DGS, you do it in seconds… even zoom into the text and looks perfect give it like 6 months… you can turn a whole city into a full detailed 3D model

el.cine

142,328 Aufrufe • vor 8 Monaten

Greenify on Vision Pro lets you turn any room into a jungle. I covered my office in plants and butterflies. Now it feels alive, and honestly, I’m into it.

Greenify on Vision Pro lets you turn any room into a jungle. I covered my office in plants and butterflies. Now it feels alive, and honestly, I’m into it.

Justin Ryan ᯅ

11,406 Aufrufe • vor 1 Jahr

I just used Luma's text-to-3D to generate a DeLorean from Back to the Future and placed it in my living room using the Vision Pro! The future is wild. 🤩

I just used Luma's text-to-3D to generate a DeLorean from Back to the Future and placed it in my living room using the Vision Pro! The future is wild. 🤩

Ammaar Reshi

265,555 Aufrufe • vor 2 Jahren

Meta released SAM3 a model to reconstruct objects from segmented images. I tried it and here are 4 things I found out - The generation is incredibly fast when compared with other 3D GenAI models - The models generated are not meshes but Gaussian Splatting. I was surprised that in the paper it was not mentioned anywhere - When generating multiple objects the arrangement is a bit messed up. - Unfortunately, it is impossible to download any of the .ply generated 😔 I cannot stop thinking about the implications of this in XR. Objects in the real world could be almost instantly turned into photorealistic copies and even rearranged to the user's wish.

Meta released SAM3 a model to reconstruct objects from segmented images. I tried it and here are 4 things I found out - The generation is incredibly fast when compared with other 3D GenAI models - The models generated are not meshes but Gaussian Splatting. I was surprised that in the paper it was not mentioned anywhere - When generating multiple objects the arrangement is a bit messed up. - Unfortunately, it is impossible to download any of the .ply generated 😔 I cannot stop thinking about the implications of this in XR. Objects in the real world could be almost instantly turned into photorealistic copies and even rearranged to the user's wish.

Gabriele Romagnoli

32,439 Aufrufe • vor 8 Monaten

Here is my first prop test with my new motion capture! I 3d scanned my chair into my digital world and I can grab it touch the chair and do all sorts! It seems to hold incredibly well.

Here is my first prop test with my new motion capture! I 3d scanned my chair into my digital world and I can grab it touch the chair and do all sorts! It seems to hold incredibly well.

CodeMiko

948,023 Aufrufe • vor 8 Monaten

🧍 Very cool idea So I added it to Photo AI as a T-Pose photo pack you can use to create a moving (or dancing) 3d model of yourself It auto-generates the correct T-Pose of your model immediately and then converts it into a 3D model you can download (as .fbx) and instantly import into valentina Mendez Mendez to rig it After rigging you can add any movement from Mixamo to move it however you want

🧍 Very cool idea So I added it to Photo AI as a T-Pose photo pack you can use to create a moving (or dancing) 3d model of yourself It auto-generates the correct T-Pose of your model immediately and then converts it into a 3D model you can download (as .fbx) and instantly import into valentina Mendez Mendez to rig it After rigging you can add any movement from Mixamo to move it however you want

@levelsio

140,555 Aufrufe • vor 7 Monaten

People are underestimating Apple in AI. I just ran Apple’s new SHARP model locally and watched my photos turn into 3D Gaussian splats in seconds, then stepped inside them on Vision Pro. This feels like the beginning of something special. You really have to try it.

People are underestimating Apple in AI. I just ran Apple’s new SHARP model locally and watched my photos turn into 3D Gaussian splats in seconds, then stepped inside them on Vision Pro. This feels like the beginning of something special. You really have to try it.

Justin Ryan

255,483 Aufrufe • vor 7 Monaten

I loved being one of the first directors to use Apple Vision Pro! I was completely blown away with how it helps you play, create, and explore new worlds. Watch Wicked now on the Apple TV app, and experience it in 3D on Apple Vision Pro.

I loved being one of the first directors to use Apple Vision Pro! I was completely blown away with how it helps you play, create, and explore new worlds. Watch Wicked now on the Apple TV app, and experience it in 3D on Apple Vision Pro.

Jon M. Chu

378,694 Aufrufe • vor 1 Jahr

You can now generate, edit, and convert a reference image into 3D inside one tool. Tripo's Image Generation runs Nano Banana and GPT to build the reference, then turns it into a model. Text or photo in, 3D out. One pipeline, zero handoffs.

You can now generate, edit, and convert a reference image into 3D inside one tool. Tripo's Image Generation runs Nano Banana and GPT to build the reference, then turns it into a model. Text or photo in, 3D out. One pipeline, zero handoffs.

Alvaro Cintas

56,246 Aufrufe • vor 2 Monaten

Flipping between real & virtual worlds with my 3D scan in Vision Pro is pure eye candy 😻 The environmental lighting change reveals all the high frequency detail baked into the normal maps 🌅 Used Sketchfab to convert my photogrammetry model to USDZ, then you can open it natively with Apple Quick Look

Flipping between real & virtual worlds with my 3D scan in Vision Pro is pure eye candy 😻 The environmental lighting change reveals all the high frequency detail baked into the normal maps 🌅 Used Sketchfab to convert my photogrammetry model to USDZ, then you can open it natively with Apple Quick Look

Bilawal Sidhu

33,459 Aufrufe • vor 2 Jahren

New paper from Apple - Sharp Monocular View Synthesis in Less than a Second Mescheder et al. @ Apple just released a very impressive paper (congrats! 🎉🥳). You give it an image and it generates a really great looking 3d Gaussian representation. Uses depth pro. It's really good. The model is about 3GB, and takes ~5-10s on my M1 Max per image. Single feedforward pass network. The video is using "Metal Splatter" to view the .ply from ml-sharp on Apple Vision Pro. Some really wow moments today trying it on different scenes.

New paper from Apple - Sharp Monocular View Synthesis in Less than a Second Mescheder et al. @ Apple just released a very impressive paper (congrats! 🎉🥳). You give it an image and it generates a really great looking 3d Gaussian representation. Uses depth pro. It's really good. The model is about 3GB, and takes ~5-10s on my M1 Max per image. Single feedforward pass network. The video is using "Metal Splatter" to view the .ply from ml-sharp on Apple Vision Pro. Some really wow moments today trying it on different scenes.

Tim Davison ᯅ

132,924 Aufrufe • vor 7 Monaten

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!

@levelsio

119,210 Aufrufe • vor 1 Jahr

✨ I made a little demo of #vibejam sponsor Tripo and how you can use it to generate assets for your games In this case I'm generating an apartment flat that's half destroyed and open for my drone sim to fly around, take cover and shoot at enemies from First I write the prompt and select Nano Banana to generate an image first, I get a few different ones, and I select the one I like Then that one is converted into a 3d object called a Smart Mesh Smart Mesh is different than regular image-to-3d models because usually you get issues with uneven polygon distribution, too dense geometry and poor edge flow, so while you think you save time with generating it with AI you end up doing lots of editing after to fix the topology which kinda defeats the point Smart Mesh doesn't have any of this, it's fast and clean low-poly models you can drop into your game Anyway, after generating the model I can then see it in 3d, and if I don't like it, regenerate it, or if I like it start texturing it Once that's done, I export it as a GLB, FBX or OBJ and drop it in (usually I use GLB as ThreeJS seems to prefer that), in my case I just drop the URL into Cursor and let it figure out the placement of the asset into my game!

✨ I made a little demo of #vibejam sponsor Tripo and how you can use it to generate assets for your games In this case I'm generating an apartment flat that's half destroyed and open for my drone sim to fly around, take cover and shoot at enemies from First I write the prompt and select Nano Banana to generate an image first, I get a few different ones, and I select the one I like Then that one is converted into a 3d object called a Smart Mesh Smart Mesh is different than regular image-to-3d models because usually you get issues with uneven polygon distribution, too dense geometry and poor edge flow, so while you think you save time with generating it with AI you end up doing lots of editing after to fix the topology which kinda defeats the point Smart Mesh doesn't have any of this, it's fast and clean low-poly models you can drop into your game Anyway, after generating the model I can then see it in 3d, and if I don't like it, regenerate it, or if I like it start texturing it Once that's done, I export it as a GLB, FBX or OBJ and drop it in (usually I use GLB as ThreeJS seems to prefer that), in my case I just drop the URL into Cursor and let it figure out the placement of the asset into my game!

@levelsio

72,338 Aufrufe • vor 3 Monaten

This is huge!! Spline now supports Gaussian splats 👀 You can now capture anything in 3D from your phone with Luma, export the .ply file, import it into spline, crop, adjust, and embed on your site. Luma + Spline + Webflow is an insane 3D workflow 🔥

This is huge!! Spline now supports Gaussian splats 👀 You can now capture anything in 3D from your phone with Luma, export the .ply file, import it into spline, crop, adjust, and embed on your site. Luma + Spline + Webflow is an insane 3D workflow 🔥

Nick St. Pierre

1,139,891 Aufrufe • vor 2 Jahren

Look at how crispy this 3d gaussian splat came out! The reflections in the painting have me floored. Captured with a Sony a7iii camera and 18mm lens. I posed the imagery using epic's reality capture and trained it with lichtfeld studio. Lichtfeld is my new favorite way to train splats -- it integrates all the latest research and it’s completely free. Also what I love about 3d capture -- you can process old datasets with new algorithms and breathe new life into them.

Look at how crispy this 3d gaussian splat came out! The reflections in the painting have me floored. Captured with a Sony a7iii camera and 18mm lens. I posed the imagery using epic's reality capture and trained it with lichtfeld studio. Lichtfeld is my new favorite way to train splats -- it integrates all the latest research and it’s completely free. Also what I love about 3d capture -- you can process old datasets with new algorithms and breathe new life into them.

Bilawal Sidhu

78,613 Aufrufe • vor 5 Monaten

my friend called me on the phone in the studio and I turned it into a song last night

my friend called me on the phone in the studio and I turned it into a song last night

Khalid

165,880 Aufrufe • vor 1 Jahr

This is SO cool 😱 Sharing Apple Vision Pro experiences together in the same room is still the most magical thing in tech for me right now. We now have two Vision Pros in our household, so we tried exploring 3D models together using SharePlay. It was incredibly smooth, with the positioning always perfectly in sync. It was the perfect way to successfully convince my wife to get the orange iPhone 17 Pro. Once everyone gets to experience this, I think they’ll start to reconsider whether wearing a headset is really niche.

This is SO cool 😱 Sharing Apple Vision Pro experiences together in the same room is still the most magical thing in tech for me right now. We now have two Vision Pros in our household, so we tried exploring 3D models together using SharePlay. It was incredibly smooth, with the positioning always perfectly in sync. It was the perfect way to successfully convince my wife to get the orange iPhone 17 Pro. Once everyone gets to experience this, I think they’ll start to reconsider whether wearing a headset is really niche.

Phil Traut ᯅ

17,399 Aufrufe • vor 9 Monaten