Loading video...

Video Failed to Load

Go Home

Adobe.. has released a tool that combines Generative Gaussian Splats with a Diffusion layer and it's not all over the internet? WHAT IS GOING ON :D I had to test this out ofc! Substance 3D viewer, the new 3d viewer just released by Adobe, not only supports viewing of...

MartinNebelong's profile picture

Martin Nebelong

33,787 subscribers

279,936 views • 1 year ago •via X (Twitter)

Science & TechnologyArts
LIVE

Anya Rossi• Live Now

Private livecam show

9 Comments

Martin Nebelong's profile picture
Martin Nebelong1 year ago

The animation towards the end was made with Luma Dream btw.

Martin Nebelong's profile picture
Martin Nebelong1 year ago

Just going to leave this here and say.. I told you so! :D

SoqllooS's profile picture
SoqllooS1 year ago

Because adobe is a cancer of the creative industry. Anyone who has been in the industry for even a few years knows that. Now they trying to recover from gigantic criticism of the entire industry a few months ago. As soon as they improve their PR a bit, they'll be ripping again.

Martin Nebelong's profile picture
Martin Nebelong1 year ago

Let's give them a bit of credit for having revolutionized the industry as well.. I remember the early days of Photoshop, the introduction of more refined digital painting tools and there's lots of things to cherish still. The whole debacle around the TOS could have been handled better, but also seemed to have been blown a bit out of proportions. The criticism around subscription costs.. I think the price I pay for the Adobe suite each month is OK.

Bob's profile picture
Bob1 year ago

Nothing would ever cause me to give them another penny

不俱戴天 // Jose's profile picture
不俱戴天 // Jose1 year ago

> A new exciting AI tool! 👀👀 > Made by Adobe. Why would we support one of the worst and anti consumer company ever in history.

William Hurst's profile picture
William Hurst1 year ago

Because fuck Adobe. Thats why.

Martin Nebelong's profile picture
Martin Nebelong1 year ago

Yes, for now it's boring in terms of actual creative control. Most Gen ai is like that still.. We need much better tools to wield this tech. I'm sure that will come.

algorusty — (Christ/acc➟✞)'s profile picture
algorusty — (Christ/acc➟✞)1 year ago

So this is what Adobe was stealing all your data for

Related Videos

Introducing Substance 3D Viewer (beta) a new 3D desktop app that can open, view, and render 70+ file formats. In Adobe Photoshop (beta), drag & drop a 3D model on your canvas, and it becomes an editable Smart Object. Download it for free and give it a try!
0:50

Introducing Substance 3D Viewer (beta) a new 3D desktop app that can open, view, and render 70+ file formats. In Adobe Photoshop (beta), drag & drop a 3D model on your canvas, and it becomes an editable Smart Object. Download it for free and give it a try!

Adobe Substance 3D

89,134 views • 1 year ago

🚨BreakingNews🚨 Generating 3D objects with Adobe is already possible! With Adobe Substance Viewer (alpha), you can do Text to 3D and 3D to Image. Two synergistic features that offer endless possibilities. Here’s a quick example with this video. And yes, it’s absolutely awesome! 🔥🔥 #AdobeMax #SubstanceViewer
0:31

🚨BreakingNews🚨 Generating 3D objects with Adobe is already possible! With Adobe Substance Viewer (alpha), you can do Text to 3D and 3D to Image. Two synergistic features that offer endless possibilities. Here’s a quick example with this video. And yes, it’s absolutely awesome! 🔥🔥 #AdobeMax #SubstanceViewer

Pierrick Chevallier | IA

78,392 views • 1 year ago

My dream to have 3D and AI in the same tool came true today. Also now you can make 3D text and turn it into magic with AI. I worked with Project Neo team closely to bring Adobe Firefly built in this intuitive 3D tool. Creative typography with 3 #CommunityXAdobe Adobe MAX
0:43

My dream to have 3D and AI in the same tool came true today. Also now you can make 3D text and turn it into magic with AI. I worked with Project Neo team closely to bring Adobe Firefly built in this intuitive 3D tool. Creative typography with 3 #CommunityXAdobe Adobe MAX

Kris Kashtanova

62,933 views • 1 year ago

Here's a look behind the scenes of how I used a 3d model, generated from an image, as a "driver" for ai animation. In the near future we'll see more 3d tools that support these types of workflows, with much more emphasis on enhancing user input instead of just letting the ai do everything. I used the 3d model to generate keyframes that I then animated in Luma Dream. By using a 3d model with a diffusion "layer" done with Krea, I got quite high quality frames with a relatively high consistency as well since the AI didn't have to "hallucinate" that much. I upscaled and detailed the frames using Magnific. Using semi-detailed 3d models as drivers for gen ai is very powerful, and it allows us to use models that are sculpted in a more free-flowing type of workflow that doesn't rely so much on high surface detailing or very time-consuming finish, but instead relies more on gestural 3d sculpting. #art #ai
0:24

Here's a look behind the scenes of how I used a 3d model, generated from an image, as a "driver" for ai animation. In the near future we'll see more 3d tools that support these types of workflows, with much more emphasis on enhancing user input instead of just letting the ai do everything. I used the 3d model to generate keyframes that I then animated in Luma Dream. By using a 3d model with a diffusion "layer" done with Krea, I got quite high quality frames with a relatively high consistency as well since the AI didn't have to "hallucinate" that much. I upscaled and detailed the frames using Magnific. Using semi-detailed 3d models as drivers for gen ai is very powerful, and it allows us to use models that are sculpted in a more free-flowing type of workflow that doesn't rely so much on high surface detailing or very time-consuming finish, but instead relies more on gestural 3d sculpting. #art #ai

Martin Nebelong

48,200 views • 1 year ago

Adobe just released its first “commercially safe” Adobe Firefly Video in public beta. You can access it in Adobe Premiere & a new Firefly mobile app. Scene to Image & Text to Image are interesting for 3D artists, as you have a lot of control over your images. What do you think?
0:56

Adobe just released its first “commercially safe” Adobe Firefly Video in public beta. You can access it in Adobe Premiere & a new Firefly mobile app. Scene to Image & Text to Image are interesting for 3D artists, as you have a lot of control over your images. What do you think?

E.J. Hassenfratz

22,858 views • 1 year ago

Running some more tests with Adobe’s new 3D model viewer, Gaussian Splatting generator, and AI image generator, 'Substance 3D Viewer.' It’s still in beta, but it’s already pretty awesome and very easy to use! 🔥 Check out what I was able to create. The models in this video were made with Tripo AI using text-to-3D, and the animations were brought to life using Hailuo and Luma Dream. This tech just keeps getting more useful! #AIArt #3DModeling #Substance3DViewer
0:24

Running some more tests with Adobe’s new 3D model viewer, Gaussian Splatting generator, and AI image generator, 'Substance 3D Viewer.' It’s still in beta, but it’s already pretty awesome and very easy to use! 🔥 Check out what I was able to create. The models in this video were made with Tripo AI using text-to-3D, and the animations were brought to life using Hailuo and Luma Dream. This tech just keeps getting more useful! #AIArt #3DModeling #Substance3DViewer

Martin Nebelong

87,613 views • 1 year ago

What could be better than a portal?! A portal that lets you switch between point clouds and 3D Gaussian Splats. Built a web-based 3D Gaussian Splat viewer with SparkJS, letting me freely fly through the three locations I just captured using the #PortalCam. #GaussianSplatting
1:33

What could be better than a portal?! A portal that lets you switch between point clouds and 3D Gaussian Splats. Built a web-based 3D Gaussian Splat viewer with SparkJS, letting me freely fly through the three locations I just captured using the #PortalCam. #GaussianSplatting

Hugues Bruyère

28,092 views • 4 months ago

🚨 Photoshop Beta just went Ultra Instinct mode with 3D Rotation. 3D Rotation + Harmonization = change the perspective…and the image adapts instantly. This is seriously a banger ! #adobe #adobephotoshop
1:00

🚨 Photoshop Beta just went Ultra Instinct mode with 3D Rotation. 3D Rotation + Harmonization = change the perspective…and the image adapts instantly. This is seriously a banger ! #adobe #adobephotoshop

Pierrick Chevallier | IA

13,330 views • 3 months ago

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!
0:51

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!

@levelsio

119,210 views • 11 months ago

Adobe is entering the image-to-3D game! Their new method, LRM, can create high-fidelity 3D meshes from a single image in just 5 seconds 🔥 It's trained on 1 million objects and is able to generate objects from real-world images and generative AI models.
0:28

Adobe is entering the image-to-3D game! Their new method, LRM, can create high-fidelity 3D meshes from a single image in just 5 seconds 🔥 It's trained on 1 million objects and is able to generate objects from real-world images and generative AI models.

Dreaming Tulpa 🥓👑

270,918 views • 2 years ago

What do you think of the new MJ editor? To me systems like that offer only the illusion of creative control.. they still take way too many of the creative choices. Good if you just want a pretty picture that is well within the understanding of the training data.. not so great for anything else. That said this is only based on a firsthand impression.. I'll be testing it more and will be happy to be proven wrong! Here's a comparison between the new editor and a more manual workflow in Photoshop using the ComfyUI Plugin. There's also a bit of the new Adobe Substance 3D viewer integration in PS for good measure. #art #ai
0:35

What do you think of the new MJ editor? To me systems like that offer only the illusion of creative control.. they still take way too many of the creative choices. Good if you just want a pretty picture that is well within the understanding of the training data.. not so great for anything else. That said this is only based on a firsthand impression.. I'll be testing it more and will be happy to be proven wrong! Here's a comparison between the new editor and a more manual workflow in Photoshop using the ComfyUI Plugin. There's also a bit of the new Adobe Substance 3D viewer integration in PS for good measure. #art #ai

Martin Nebelong

35,740 views • 1 year ago

More Adobe Substance Modeler +AI experiments. Using quick, gestural 3d sketching to drive generative AI with much higher levels of creative control than you could ever get from a text prompt alone. The more detailed your 3d model is, the more you can leave the ai to just finish details like skin texture and individual strands of hair.. my model is obviously just a quick sketch😅 #art #ai
0:54

More Adobe Substance Modeler +AI experiments. Using quick, gestural 3d sketching to drive generative AI with much higher levels of creative control than you could ever get from a text prompt alone. The more detailed your 3d model is, the more you can leave the ai to just finish details like skin texture and individual strands of hair.. my model is obviously just a quick sketch😅 #art #ai

Martin Nebelong

56,535 views • 2 years ago

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!
2:41

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!

Santiago

65,308 views • 1 month ago

How to create this cartoon 3D text effect in Adobe Photoshop
5:29

How to create this cartoon 3D text effect in Adobe Photoshop

Photoshop Tricks!

44,902 views • 1 year ago

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.
1:10

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

MrNeRF

66,016 views • 7 months ago

3D-LLM: Injecting the 3D World into Large Language Models paper page: Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves richer concepts such as spatial relationships, affordances, physics, layout, and so on. In this work, we propose to inject the 3D world into large language models and introduce a whole new family of 3D-LLMs. Specifically, 3D-LLMs can take 3D point clouds and their features as input and perform a diverse set of 3D-related tasks, including captioning, dense captioning, 3D question answering, task decomposition, 3D grounding, 3D-assisted dialog, navigation, and so on. Using three types of prompting mechanisms that we design, we are able to collect over 300k 3D-language data covering these tasks. To efficiently train 3D-LLMs, we first utilize a 3D feature extractor that obtains 3D features from rendered multi- view images. Then, we use 2D VLMs as our backbones to train our 3D-LLMs. By introducing a 3D localization mechanism, 3D-LLMs can better capture 3D spatial information. Experiments on ScanQA show that our model outperforms state-of-the-art baselines by a large margin (e.g., the BLEU-1 score surpasses state-of-the-art score by 9%). Furthermore, experiments on our held-in datasets for 3D captioning, task composition, and 3D-assisted dialogue show that our model outperforms 2D VLMs. Qualitative examples also show that our model could perform more tasks beyond the scope of existing LLMs and VLMs.
0:50

3D-LLM: Injecting the 3D World into Large Language Models paper page: Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves richer concepts such as spatial relationships, affordances, physics, layout, and so on. In this work, we propose to inject the 3D world into large language models and introduce a whole new family of 3D-LLMs. Specifically, 3D-LLMs can take 3D point clouds and their features as input and perform a diverse set of 3D-related tasks, including captioning, dense captioning, 3D question answering, task decomposition, 3D grounding, 3D-assisted dialog, navigation, and so on. Using three types of prompting mechanisms that we design, we are able to collect over 300k 3D-language data covering these tasks. To efficiently train 3D-LLMs, we first utilize a 3D feature extractor that obtains 3D features from rendered multi- view images. Then, we use 2D VLMs as our backbones to train our 3D-LLMs. By introducing a 3D localization mechanism, 3D-LLMs can better capture 3D spatial information. Experiments on ScanQA show that our model outperforms state-of-the-art baselines by a large margin (e.g., the BLEU-1 score surpasses state-of-the-art score by 9%). Furthermore, experiments on our held-in datasets for 3D captioning, task composition, and 3D-assisted dialogue show that our model outperforms 2D VLMs. Qualitative examples also show that our model could perform more tasks beyond the scope of existing LLMs and VLMs.

AK

249,494 views • 2 years ago

Painting with 3D Gaussian Splat Brushes Contributions: • Designing a set of interactive tools and brush parameters for artistic brush creation and control using 3DGS content. • Computing oriented 3D Gaussian splat brushes for stamp-based painting on 3D surfaces represented as meshes or 3DGS scenes. • Deforming the splats in a brush stamp to ensure a smooth appearance of the painted 3D stroke. • Producing seamless brush strokes despite overlapping brush stamps, using diffusion inpainting. • Efficient modeling and rendering of brush strokes to facilitate 3DGS painting in real time.
0:27

Painting with 3D Gaussian Splat Brushes Contributions: • Designing a set of interactive tools and brush parameters for artistic brush creation and control using 3DGS content. • Computing oriented 3D Gaussian splat brushes for stamp-based painting on 3D surfaces represented as meshes or 3DGS scenes. • Deforming the splats in a brush stamp to ensure a smooth appearance of the painted 3D stroke. • Producing seamless brush strokes despite overlapping brush stamps, using diffusion inpainting. • Efficient modeling and rendering of brush strokes to facilitate 3DGS painting in real time.

MrNeRF

22,958 views • 11 months ago

I had to do this of course - test out the new Google Omni Flash model with my favorite 3d art sandbox - Dreams. Just a quick test for now.. I'll be sharing more examples and techniques soon but wanted to show you this one. There's something very fitting about combining "handmade" 3d models and animations sculpted from scratch in software that runs on 2013 hardware, with some of the most advanced AI technology in the world. As part of my work for Google, I've used Google V2V models on a few different projects now - Ancestra, Dear Upstairs Neighbors and most recently one of the IO films (I'll share more about that project soon) 🥰 - and video continues to be my favorite form of input for Generative Ai workflows. If an image says more than a thousand words, a video says more than a million. And knowing that these capabilities are now in the hands of all of you, makes me very excited to see the new workflows and projects that will come out of it. What do you think of Omni so far?
0:45

I had to do this of course - test out the new Google Omni Flash model with my favorite 3d art sandbox - Dreams. Just a quick test for now.. I'll be sharing more examples and techniques soon but wanted to show you this one. There's something very fitting about combining "handmade" 3d models and animations sculpted from scratch in software that runs on 2013 hardware, with some of the most advanced AI technology in the world. As part of my work for Google, I've used Google V2V models on a few different projects now - Ancestra, Dear Upstairs Neighbors and most recently one of the IO films (I'll share more about that project soon) 🥰 - and video continues to be my favorite form of input for Generative Ai workflows. If an image says more than a thousand words, a video says more than a million. And knowing that these capabilities are now in the hands of all of you, makes me very excited to see the new workflows and projects that will come out of it. What do you think of Omni so far?

Martin Nebelong

38,076 views • 21 days ago

This might be the craziest workflow you'll see this week. From #VR greyboxing to 3D worlds with the help of #AI. The 2 tools I used are ShapesXR and Marble from World Labs. Let me tell you why and how. - ShapesXR is the most powerful and fastest way to assemble 3D scenes at scale. - The library of assets + ability to sketch from procedural primitives gives the perfect balance between speed and freedom. - ShapesXR allows you to export your creation as a glTF that can be used as a "3D prompt" into Marble - Marble now allows you to create a panorama using a 3D scene as input increasing DRAMATICALLY the control you have during the creation process - Through the workflow you can adjust textures and objects in the scene using AI inpainting - There are tons of options on how to use the final output (create a #GaussianSplatting, export collision mesh and even a detailed mesh 🤯) This is the perfect examples of how VR creative tools improve and accelerate the design process... so make sure to follow me if that's your jam 😉.
1:01

This might be the craziest workflow you'll see this week. From #VR greyboxing to 3D worlds with the help of #AI. The 2 tools I used are ShapesXR and Marble from World Labs. Let me tell you why and how. - ShapesXR is the most powerful and fastest way to assemble 3D scenes at scale. - The library of assets + ability to sketch from procedural primitives gives the perfect balance between speed and freedom. - ShapesXR allows you to export your creation as a glTF that can be used as a "3D prompt" into Marble - Marble now allows you to create a panorama using a 3D scene as input increasing DRAMATICALLY the control you have during the creation process - Through the workflow you can adjust textures and objects in the scene using AI inpainting - There are tons of options on how to use the final output (create a #GaussianSplatting, export collision mesh and even a detailed mesh 🤯) This is the perfect examples of how VR creative tools improve and accelerate the design process... so make sure to follow me if that's your jam 😉.

Gabriele Romagnoli

20,126 views • 6 months ago

This is huge!! Spline now supports Gaussian splats 👀 You can now capture anything in 3D from your phone with Luma, export the .ply file, import it into spline, crop, adjust, and embed on your site. Luma + Spline + Webflow is an insane 3D workflow 🔥
0:37

This is huge!! Spline now supports Gaussian splats 👀 You can now capture anything in 3D from your phone with Luma, export the .ply file, import it into spline, crop, adjust, and embed on your site. Luma + Spline + Webflow is an insane 3D workflow 🔥

Nick St. Pierre

1,139,640 views • 2 years ago