正在加载视频...

视频加载失败

返回首页

Adobe.. has released a tool that combines Generative Gaussian Splats with a Diffusion layer and it's not all over the internet? WHAT IS GOING ON :D I had to test this out ofc! Substance 3D viewer, the new 3d viewer just released by Adobe, not only supports viewing of...

MartinNebelong's profile picture

Martin Nebelong

33,787 subscribers

279,936 次观看 • 1 年前 •via X (Twitter)

科学技术艺术
LIVE

Anya Rossi• Live Now

Private livecam show

9 条评论

Martin Nebelong 的头像
Martin Nebelong1 年前

The animation towards the end was made with Luma Dream btw.

Martin Nebelong 的头像
Martin Nebelong1 年前

Just going to leave this here and say.. I told you so! :D

SoqllooS 的头像
SoqllooS1 年前

Because adobe is a cancer of the creative industry. Anyone who has been in the industry for even a few years knows that. Now they trying to recover from gigantic criticism of the entire industry a few months ago. As soon as they improve their PR a bit, they'll be ripping again.

Martin Nebelong 的头像
Martin Nebelong1 年前

Let's give them a bit of credit for having revolutionized the industry as well.. I remember the early days of Photoshop, the introduction of more refined digital painting tools and there's lots of things to cherish still. The whole debacle around the TOS could have been handled better, but also seemed to have been blown a bit out of proportions. The criticism around subscription costs.. I think the price I pay for the Adobe suite each month is OK.

Bob 的头像
Bob1 年前

Nothing would ever cause me to give them another penny

不俱戴天 // Jose 的头像
不俱戴天 // Jose1 年前

> A new exciting AI tool! 👀👀 > Made by Adobe. Why would we support one of the worst and anti consumer company ever in history.

William Hurst 的头像
William Hurst1 年前

Because fuck Adobe. Thats why.

Martin Nebelong 的头像
Martin Nebelong1 年前

Yes, for now it's boring in terms of actual creative control. Most Gen ai is like that still.. We need much better tools to wield this tech. I'm sure that will come.

algorusty — (Christ/acc➟✞) 的头像
algorusty — (Christ/acc➟✞)1 年前

So this is what Adobe was stealing all your data for

相关视频

Introducing Substance 3D Viewer (beta) a new 3D desktop app that can open, view, and render 70+ file formats. In Adobe Photoshop (beta), drag & drop a 3D model on your canvas, and it becomes an editable Smart Object. Download it for free and give it a try!
0:50

Introducing Substance 3D Viewer (beta) a new 3D desktop app that can open, view, and render 70+ file formats. In Adobe Photoshop (beta), drag & drop a 3D model on your canvas, and it becomes an editable Smart Object. Download it for free and give it a try!

Adobe Substance 3D

89,134 次观看 • 1 年前

🚨BreakingNews🚨 Generating 3D objects with Adobe is already possible! With Adobe Substance Viewer (alpha), you can do Text to 3D and 3D to Image. Two synergistic features that offer endless possibilities. Here’s a quick example with this video. And yes, it’s absolutely awesome! 🔥🔥 #AdobeMax #SubstanceViewer
0:31

🚨BreakingNews🚨 Generating 3D objects with Adobe is already possible! With Adobe Substance Viewer (alpha), you can do Text to 3D and 3D to Image. Two synergistic features that offer endless possibilities. Here’s a quick example with this video. And yes, it’s absolutely awesome! 🔥🔥 #AdobeMax #SubstanceViewer

Pierrick Chevallier | IA

78,392 次观看 • 1 年前

My dream to have 3D and AI in the same tool came true today. Also now you can make 3D text and turn it into magic with AI. I worked with Project Neo team closely to bring Adobe Firefly built in this intuitive 3D tool. Creative typography with 3 #CommunityXAdobe Adobe MAX
0:43

My dream to have 3D and AI in the same tool came true today. Also now you can make 3D text and turn it into magic with AI. I worked with Project Neo team closely to bring Adobe Firefly built in this intuitive 3D tool. Creative typography with 3 #CommunityXAdobe Adobe MAX

Kris Kashtanova

62,933 次观看 • 1 年前

Here's a look behind the scenes of how I used a 3d model, generated from an image, as a "driver" for ai animation. In the near future we'll see more 3d tools that support these types of workflows, with much more emphasis on enhancing user input instead of just letting the ai do everything. I used the 3d model to generate keyframes that I then animated in Luma Dream. By using a 3d model with a diffusion "layer" done with Krea, I got quite high quality frames with a relatively high consistency as well since the AI didn't have to "hallucinate" that much. I upscaled and detailed the frames using Magnific. Using semi-detailed 3d models as drivers for gen ai is very powerful, and it allows us to use models that are sculpted in a more free-flowing type of workflow that doesn't rely so much on high surface detailing or very time-consuming finish, but instead relies more on gestural 3d sculpting. #art #ai
0:24

Here's a look behind the scenes of how I used a 3d model, generated from an image, as a "driver" for ai animation. In the near future we'll see more 3d tools that support these types of workflows, with much more emphasis on enhancing user input instead of just letting the ai do everything. I used the 3d model to generate keyframes that I then animated in Luma Dream. By using a 3d model with a diffusion "layer" done with Krea, I got quite high quality frames with a relatively high consistency as well since the AI didn't have to "hallucinate" that much. I upscaled and detailed the frames using Magnific. Using semi-detailed 3d models as drivers for gen ai is very powerful, and it allows us to use models that are sculpted in a more free-flowing type of workflow that doesn't rely so much on high surface detailing or very time-consuming finish, but instead relies more on gestural 3d sculpting. #art #ai

Martin Nebelong

48,200 次观看 • 1 年前

Adobe just released its first “commercially safe” Adobe Firefly Video in public beta. You can access it in Adobe Premiere & a new Firefly mobile app. Scene to Image & Text to Image are interesting for 3D artists, as you have a lot of control over your images. What do you think?
0:56

Adobe just released its first “commercially safe” Adobe Firefly Video in public beta. You can access it in Adobe Premiere & a new Firefly mobile app. Scene to Image & Text to Image are interesting for 3D artists, as you have a lot of control over your images. What do you think?

E.J. Hassenfratz

22,858 次观看 • 1 年前

Running some more tests with Adobe’s new 3D model viewer, Gaussian Splatting generator, and AI image generator, 'Substance 3D Viewer.' It’s still in beta, but it’s already pretty awesome and very easy to use! 🔥 Check out what I was able to create. The models in this video were made with Tripo AI using text-to-3D, and the animations were brought to life using Hailuo and Luma Dream. This tech just keeps getting more useful! #AIArt #3DModeling #Substance3DViewer
0:24

Running some more tests with Adobe’s new 3D model viewer, Gaussian Splatting generator, and AI image generator, 'Substance 3D Viewer.' It’s still in beta, but it’s already pretty awesome and very easy to use! 🔥 Check out what I was able to create. The models in this video were made with Tripo AI using text-to-3D, and the animations were brought to life using Hailuo and Luma Dream. This tech just keeps getting more useful! #AIArt #3DModeling #Substance3DViewer

Martin Nebelong

87,613 次观看 • 1 年前

What could be better than a portal?! A portal that lets you switch between point clouds and 3D Gaussian Splats. Built a web-based 3D Gaussian Splat viewer with SparkJS, letting me freely fly through the three locations I just captured using the #PortalCam. #GaussianSplatting
1:33

What could be better than a portal?! A portal that lets you switch between point clouds and 3D Gaussian Splats. Built a web-based 3D Gaussian Splat viewer with SparkJS, letting me freely fly through the three locations I just captured using the #PortalCam. #GaussianSplatting

Hugues Bruyère

28,092 次观看 • 4 个月前

🚨 Photoshop Beta just went Ultra Instinct mode with 3D Rotation. 3D Rotation + Harmonization = change the perspective…and the image adapts instantly. This is seriously a banger ! #adobe #adobephotoshop
1:00

🚨 Photoshop Beta just went Ultra Instinct mode with 3D Rotation. 3D Rotation + Harmonization = change the perspective…and the image adapts instantly. This is seriously a banger ! #adobe #adobephotoshop

Pierrick Chevallier | IA

13,330 次观看 • 3 个月前

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!
0:51

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!

@levelsio

119,210 次观看 • 11 个月前

Adobe is entering the image-to-3D game! Their new method, LRM, can create high-fidelity 3D meshes from a single image in just 5 seconds 🔥 It's trained on 1 million objects and is able to generate objects from real-world images and generative AI models.
0:28

Adobe is entering the image-to-3D game! Their new method, LRM, can create high-fidelity 3D meshes from a single image in just 5 seconds 🔥 It's trained on 1 million objects and is able to generate objects from real-world images and generative AI models.

Dreaming Tulpa 🥓👑

270,918 次观看 • 2 年前

What do you think of the new MJ editor? To me systems like that offer only the illusion of creative control.. they still take way too many of the creative choices. Good if you just want a pretty picture that is well within the understanding of the training data.. not so great for anything else. That said this is only based on a firsthand impression.. I'll be testing it more and will be happy to be proven wrong! Here's a comparison between the new editor and a more manual workflow in Photoshop using the ComfyUI Plugin. There's also a bit of the new Adobe Substance 3D viewer integration in PS for good measure. #art #ai
0:35

What do you think of the new MJ editor? To me systems like that offer only the illusion of creative control.. they still take way too many of the creative choices. Good if you just want a pretty picture that is well within the understanding of the training data.. not so great for anything else. That said this is only based on a firsthand impression.. I'll be testing it more and will be happy to be proven wrong! Here's a comparison between the new editor and a more manual workflow in Photoshop using the ComfyUI Plugin. There's also a bit of the new Adobe Substance 3D viewer integration in PS for good measure. #art #ai

Martin Nebelong

35,740 次观看 • 1 年前

More Adobe Substance Modeler +AI experiments. Using quick, gestural 3d sketching to drive generative AI with much higher levels of creative control than you could ever get from a text prompt alone. The more detailed your 3d model is, the more you can leave the ai to just finish details like skin texture and individual strands of hair.. my model is obviously just a quick sketch😅 #art #ai
0:54

More Adobe Substance Modeler +AI experiments. Using quick, gestural 3d sketching to drive generative AI with much higher levels of creative control than you could ever get from a text prompt alone. The more detailed your 3d model is, the more you can leave the ai to just finish details like skin texture and individual strands of hair.. my model is obviously just a quick sketch😅 #art #ai

Martin Nebelong

56,535 次观看 • 2 年前

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!
2:41

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!

Santiago

65,308 次观看 • 1 个月前

How to create this cartoon 3D text effect in Adobe Photoshop
5:29

How to create this cartoon 3D text effect in Adobe Photoshop

Photoshop Tricks!

44,902 次观看 • 1 年前

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.
1:10

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

MrNeRF

66,016 次观看 • 7 个月前

3D-LLM: Injecting the 3D World into Large Language Models paper page: Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves richer concepts such as spatial relationships, affordances, physics, layout, and so on. In this work, we propose to inject the 3D world into large language models and introduce a whole new family of 3D-LLMs. Specifically, 3D-LLMs can take 3D point clouds and their features as input and perform a diverse set of 3D-related tasks, including captioning, dense captioning, 3D question answering, task decomposition, 3D grounding, 3D-assisted dialog, navigation, and so on. Using three types of prompting mechanisms that we design, we are able to collect over 300k 3D-language data covering these tasks. To efficiently train 3D-LLMs, we first utilize a 3D feature extractor that obtains 3D features from rendered multi- view images. Then, we use 2D VLMs as our backbones to train our 3D-LLMs. By introducing a 3D localization mechanism, 3D-LLMs can better capture 3D spatial information. Experiments on ScanQA show that our model outperforms state-of-the-art baselines by a large margin (e.g., the BLEU-1 score surpasses state-of-the-art score by 9%). Furthermore, experiments on our held-in datasets for 3D captioning, task composition, and 3D-assisted dialogue show that our model outperforms 2D VLMs. Qualitative examples also show that our model could perform more tasks beyond the scope of existing LLMs and VLMs.
0:50

3D-LLM: Injecting the 3D World into Large Language Models paper page: Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves richer concepts such as spatial relationships, affordances, physics, layout, and so on. In this work, we propose to inject the 3D world into large language models and introduce a whole new family of 3D-LLMs. Specifically, 3D-LLMs can take 3D point clouds and their features as input and perform a diverse set of 3D-related tasks, including captioning, dense captioning, 3D question answering, task decomposition, 3D grounding, 3D-assisted dialog, navigation, and so on. Using three types of prompting mechanisms that we design, we are able to collect over 300k 3D-language data covering these tasks. To efficiently train 3D-LLMs, we first utilize a 3D feature extractor that obtains 3D features from rendered multi- view images. Then, we use 2D VLMs as our backbones to train our 3D-LLMs. By introducing a 3D localization mechanism, 3D-LLMs can better capture 3D spatial information. Experiments on ScanQA show that our model outperforms state-of-the-art baselines by a large margin (e.g., the BLEU-1 score surpasses state-of-the-art score by 9%). Furthermore, experiments on our held-in datasets for 3D captioning, task composition, and 3D-assisted dialogue show that our model outperforms 2D VLMs. Qualitative examples also show that our model could perform more tasks beyond the scope of existing LLMs and VLMs.

AK

249,494 次观看 • 2 年前

Painting with 3D Gaussian Splat Brushes Contributions: • Designing a set of interactive tools and brush parameters for artistic brush creation and control using 3DGS content. • Computing oriented 3D Gaussian splat brushes for stamp-based painting on 3D surfaces represented as meshes or 3DGS scenes. • Deforming the splats in a brush stamp to ensure a smooth appearance of the painted 3D stroke. • Producing seamless brush strokes despite overlapping brush stamps, using diffusion inpainting. • Efficient modeling and rendering of brush strokes to facilitate 3DGS painting in real time.
0:27

Painting with 3D Gaussian Splat Brushes Contributions: • Designing a set of interactive tools and brush parameters for artistic brush creation and control using 3DGS content. • Computing oriented 3D Gaussian splat brushes for stamp-based painting on 3D surfaces represented as meshes or 3DGS scenes. • Deforming the splats in a brush stamp to ensure a smooth appearance of the painted 3D stroke. • Producing seamless brush strokes despite overlapping brush stamps, using diffusion inpainting. • Efficient modeling and rendering of brush strokes to facilitate 3DGS painting in real time.

MrNeRF

22,958 次观看 • 11 个月前

I had to do this of course - test out the new Google Omni Flash model with my favorite 3d art sandbox - Dreams. Just a quick test for now.. I'll be sharing more examples and techniques soon but wanted to show you this one. There's something very fitting about combining "handmade" 3d models and animations sculpted from scratch in software that runs on 2013 hardware, with some of the most advanced AI technology in the world. As part of my work for Google, I've used Google V2V models on a few different projects now - Ancestra, Dear Upstairs Neighbors and most recently one of the IO films (I'll share more about that project soon) 🥰 - and video continues to be my favorite form of input for Generative Ai workflows. If an image says more than a thousand words, a video says more than a million. And knowing that these capabilities are now in the hands of all of you, makes me very excited to see the new workflows and projects that will come out of it. What do you think of Omni so far?
0:45

I had to do this of course - test out the new Google Omni Flash model with my favorite 3d art sandbox - Dreams. Just a quick test for now.. I'll be sharing more examples and techniques soon but wanted to show you this one. There's something very fitting about combining "handmade" 3d models and animations sculpted from scratch in software that runs on 2013 hardware, with some of the most advanced AI technology in the world. As part of my work for Google, I've used Google V2V models on a few different projects now - Ancestra, Dear Upstairs Neighbors and most recently one of the IO films (I'll share more about that project soon) 🥰 - and video continues to be my favorite form of input for Generative Ai workflows. If an image says more than a thousand words, a video says more than a million. And knowing that these capabilities are now in the hands of all of you, makes me very excited to see the new workflows and projects that will come out of it. What do you think of Omni so far?

Martin Nebelong

38,076 次观看 • 22 天前

This might be the craziest workflow you'll see this week. From #VR greyboxing to 3D worlds with the help of #AI. The 2 tools I used are ShapesXR and Marble from World Labs. Let me tell you why and how. - ShapesXR is the most powerful and fastest way to assemble 3D scenes at scale. - The library of assets + ability to sketch from procedural primitives gives the perfect balance between speed and freedom. - ShapesXR allows you to export your creation as a glTF that can be used as a "3D prompt" into Marble - Marble now allows you to create a panorama using a 3D scene as input increasing DRAMATICALLY the control you have during the creation process - Through the workflow you can adjust textures and objects in the scene using AI inpainting - There are tons of options on how to use the final output (create a #GaussianSplatting, export collision mesh and even a detailed mesh 🤯) This is the perfect examples of how VR creative tools improve and accelerate the design process... so make sure to follow me if that's your jam 😉.
1:01

This might be the craziest workflow you'll see this week. From #VR greyboxing to 3D worlds with the help of #AI. The 2 tools I used are ShapesXR and Marble from World Labs. Let me tell you why and how. - ShapesXR is the most powerful and fastest way to assemble 3D scenes at scale. - The library of assets + ability to sketch from procedural primitives gives the perfect balance between speed and freedom. - ShapesXR allows you to export your creation as a glTF that can be used as a "3D prompt" into Marble - Marble now allows you to create a panorama using a 3D scene as input increasing DRAMATICALLY the control you have during the creation process - Through the workflow you can adjust textures and objects in the scene using AI inpainting - There are tons of options on how to use the final output (create a #GaussianSplatting, export collision mesh and even a detailed mesh 🤯) This is the perfect examples of how VR creative tools improve and accelerate the design process... so make sure to follow me if that's your jam 😉.

Gabriele Romagnoli

20,126 次观看 • 6 个月前

This is huge!! Spline now supports Gaussian splats 👀 You can now capture anything in 3D from your phone with Luma, export the .ply file, import it into spline, crop, adjust, and embed on your site. Luma + Spline + Webflow is an insane 3D workflow 🔥
0:37

This is huge!! Spline now supports Gaussian splats 👀 You can now capture anything in 3D from your phone with Luma, export the .ply file, import it into spline, crop, adjust, and embed on your site. Luma + Spline + Webflow is an insane 3D workflow 🔥

Nick St. Pierre

1,139,640 次观看 • 2 年前